Jul 05 03:27:43.844971 np0000004562 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jul 05 03:27:45.469406 np0000004562 nova-compute[99148]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=99148) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jul 05 03:27:45.469869 np0000004562 nova-compute[99148]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=99148) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jul 05 03:27:45.469921 np0000004562 nova-compute[99148]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jul 05 03:27:45.609643 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:27:45.621310 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.012s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:27:45.669749 np0000004562 nova-compute[99148]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jul 05 03:27:46.416182 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jul 05 03:27:46.416337 np0000004562 nova-compute[99148]: INFO nova.utils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] The long task thread pool MainProcess.long_task is initialized Jul 05 03:27:46.416588 np0000004562 nova-compute[99148]: INFO nova.virt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Loading compute driver 'libvirt.LibvirtDriver' Jul 05 03:27:46.614510 np0000004562 nova-compute[99148]: INFO nova.compute.provider_config [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jul 05 03:27:47.116552 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Acquiring lock "singleton_lock" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:27:47.117682 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Acquired lock "singleton_lock" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:27:47.117682 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Releasing lock "singleton_lock" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:27:47.117682 np0000004562 nova-compute[99148]: WARNING oslo_service.backend._threading.service [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] no_fork=True: running service in main process Jul 05 03:27:47.117682 np0000004562 nova-compute[99148]: INFO nova.service [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Starting compute node (version 33.1.0) Jul 05 03:27:47.620660 np0000004562 nova-compute[99148]: INFO nova.utils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] The default thread pool MainProcess.default is initialized Jul 05 03:27:47.621196 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:27:47.621410 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Starting event thread {{(pid=99148) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jul 05 03:27:47.621789 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Starting connection event dispatch thread {{(pid=99148) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jul 05 03:27:47.622276 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Connecting to libvirt: qemu:///system {{(pid=99148) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jul 05 03:27:48.173108 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Registering for lifecycle events {{(pid=99148) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jul 05 03:27:48.174042 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Registering for connection events: {{(pid=99148) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jul 05 03:27:48.174533 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Connection event '1' reason 'None' Jul 05 03:27:48.679619 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Cannot update service status on host "np0000004562" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000004562 could not be found. Jul 05 03:27:48.680070 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.mount [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Initialising _HostMountState generation 0 {{(pid=99148) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host capabilities Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: de1635b4-ec41-49bb-8f98-49c84ee19729 Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: tcp Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: rdma Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.868274 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: 65844272 Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: 16461068 Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: 0 Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: 0 Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.869928 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: apparmor Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: 0 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: dac Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: 0 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: +64055:+993 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: +64055:+993 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-alpha Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: clipper Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-arm Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: qcom-dc-scm-v1-bmc Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: mori-bmc Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: ast2600-evb Jul 05 03:27:58.870690 np0000004562 nova-compute[99148]: borzoi Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: tiogapass-bmc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: spitz Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.7 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: nuri Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mcimx7d-sabre Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: romulus-bmc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-3.0 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-5.0 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: npcm750-evb Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.10 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: rainier-bmc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mps3-an547 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: musca-b1 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: realview-pbx-a9 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: versatileab Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: kzm Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.8 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: fby35-bmc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: musca-a Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-3.1 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mcimx6ul-evk Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-5.1 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: smdkc210 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: sx1 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.11 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: imx25-pdk Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: stm32vldiscovery Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.9 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: orangepi-pc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: quanta-q71l-bmc Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: z2 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-5.2 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: xilinx-zynq-a9 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: tosa Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mps2-an500 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: virt-2.12 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mps2-an521 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: sabrelite Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: mps2-an511 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: canon-a1100 Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: realview-eb Jul 05 03:27:58.871675 np0000004562 nova-compute[99148]: quanta-gbs-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: emcraft-sf2 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: realview-pb-a8 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: yosemitev2-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-7.0 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-4.0 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: raspi1ap Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: palmetto-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: sx1-v1 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: n810 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: g220a-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: n800 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: bletchley-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-7.1 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: tacoma-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-4.1 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: quanta-gsj Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: versatilepb Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: terrier Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: mainstone Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: realview-eb-mpcore Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: integratorcp Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-7.2 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: supermicrox11-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-4.2 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: witherspoon-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: qcom-firework-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: mps3-an524 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: kudo-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: vexpress-a9 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: midway Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: musicpal Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: lm3s811evb Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: lm3s6965evb Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: supermicro-x11spi-bmc Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: microbit Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: fby35 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: mps2-an505 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: mps2-an385 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-6.0 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: virt-8.0 Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: cubieboard Jul 05 03:27:58.872352 np0000004562 nova-compute[99148]: ast1030-evb Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: verdex Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: bpim2u Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: netduino2 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: mps2-an386 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: olimex-stm32-h405 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-6.1 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-8.1 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: raspi2b Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: vexpress-a15 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: fuji-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-6.2 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: sonorapass-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: cheetah Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-2.6 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: ast2500-evb Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: highbank Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: akita Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: connex Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: netduinoplus2 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: collie Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: raspi0 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: fp5280g2-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-arm Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: qcom-dc-scm-v1-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: mori-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: ast2600-evb Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: borzoi Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: tiogapass-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: spitz Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-2.7 Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: nuri Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: mcimx7d-sabre Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: romulus-bmc Jul 05 03:27:58.873172 np0000004562 nova-compute[99148]: virt-3.0 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-5.0 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: npcm750-evb Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-2.10 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: rainier-bmc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: mps3-an547 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: musca-b1 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: realview-pbx-a9 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: versatileab Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: kzm Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-2.8 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: fby35-bmc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: musca-a Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-3.1 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: mcimx6ul-evk Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-5.1 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: smdkc210 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: sx1 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-2.11 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: imx25-pdk Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: stm32vldiscovery Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-2.9 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: orangepi-pc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: quanta-q71l-bmc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: z2 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-5.2 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: xilinx-zynq-a9 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: tosa Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: mps2-an500 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-2.12 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: mps2-an521 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: sabrelite Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: mps2-an511 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: canon-a1100 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: realview-eb Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: quanta-gbs-bmc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: emcraft-sf2 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: realview-pb-a8 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: yosemitev2-bmc Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-7.0 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: virt-4.0 Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: raspi1ap Jul 05 03:27:58.874104 np0000004562 nova-compute[99148]: palmetto-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: sx1-v1 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: n810 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: g220a-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: n800 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: bletchley-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-7.1 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: tacoma-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-4.1 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: quanta-gsj Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: versatilepb Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: terrier Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: mainstone Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: realview-eb-mpcore Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: integratorcp Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-7.2 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: supermicrox11-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-4.2 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: witherspoon-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: qcom-firework-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: mps3-an524 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: kudo-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: vexpress-a9 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: midway Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: musicpal Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: lm3s811evb Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: lm3s6965evb Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: supermicro-x11spi-bmc Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: microbit Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: fby35 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: mps2-an505 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: mps2-an385 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-6.0 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-8.0 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: cubieboard Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: ast1030-evb Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: verdex Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: bpim2u Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: netduino2 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: mps2-an386 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: olimex-stm32-h405 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-6.1 Jul 05 03:27:58.874926 np0000004562 nova-compute[99148]: virt-8.1 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: raspi2b Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: vexpress-a15 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: fuji-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-6.2 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: sonorapass-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: cheetah Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-2.6 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: ast2500-evb Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: highbank Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: akita Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: connex Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: netduinoplus2 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: collie Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: raspi0 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: fp5280g2-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-aarch64 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: qcom-dc-scm-v1-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: mori-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: ast2600-evb Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: borzoi Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: tiogapass-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: spitz Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-2.7 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: nuri Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: mcimx7d-sabre Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: romulus-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-3.0 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-5.0 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: npcm750-evb Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-2.10 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: rainier-bmc Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: mps3-an547 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: virt-2.8 Jul 05 03:27:58.875894 np0000004562 nova-compute[99148]: musca-b1 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: realview-pbx-a9 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: versatileab Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: kzm Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: fby35-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: musca-a Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-3.1 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: mcimx6ul-evk Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-5.1 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: smdkc210 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: sx1 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-2.11 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: imx25-pdk Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: stm32vldiscovery Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-2.9 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: orangepi-pc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: quanta-q71l-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: z2 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-5.2 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: xilinx-zynq-a9 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: xlnx-zcu102 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: tosa Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: mps2-an500 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-2.12 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: mps2-an521 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: sabrelite Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: mps2-an511 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: canon-a1100 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: realview-eb Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: quanta-gbs-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: emcraft-sf2 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: realview-pb-a8 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: sbsa-ref Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: yosemitev2-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-7.0 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: virt-4.0 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: raspi1ap Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: palmetto-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: sx1-v1 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: n810 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: g220a-bmc Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: n800 Jul 05 03:27:58.876906 np0000004562 nova-compute[99148]: bletchley-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-7.1 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: tacoma-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-4.1 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: quanta-gsj Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: versatilepb Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: terrier Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: mainstone Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: realview-eb-mpcore Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: integratorcp Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-7.2 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: supermicrox11-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-4.2 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: witherspoon-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: qcom-firework-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: mps3-an524 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: kudo-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: vexpress-a9 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: midway Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: musicpal Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: lm3s811evb Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: lm3s6965evb Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: supermicro-x11spi-bmc Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: microbit Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: fby35 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: mps2-an505 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: mps2-an385 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-6.0 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-8.0 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: raspi3ap Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: cubieboard Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: ast1030-evb Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: verdex Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: bpim2u Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: netduino2 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: xlnx-versal-virt Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: mps2-an386 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: olimex-stm32-h405 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-6.1 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: virt-8.1 Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: raspi3b Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: raspi2b Jul 05 03:27:58.877811 np0000004562 nova-compute[99148]: vexpress-a15 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: fuji-bmc Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: virt-6.2 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: sonorapass-bmc Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: cheetah Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: virt-2.6 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: ast2500-evb Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: highbank Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: akita Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: connex Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: netduinoplus2 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: collie Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: raspi0 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: fp5280g2-bmc Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-cris Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: axis-dev88 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-i386 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-noble-v2 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: ubuntu Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-q35-mantic Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-impish-hpb Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-q35-5.2 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-q35-lunar-hpb Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-mantic Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-2.12 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-2.0 Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-i440fx-xenial Jul 05 03:27:58.878604 np0000004562 nova-compute[99148]: pc-q35-kinetic Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-6.2 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-4.2 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-mantic-maxcpus Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-2.5 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-4.2 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-focal Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-hirsute Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-xenial Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-jammy-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-5.2 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-2.7 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-eoan-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-disco-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-groovy Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-zesty Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-lunar Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-mantic-hpb-maxcpus Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-groovy Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-7.1 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-artful Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-trusty Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-2.2 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-eoan-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-focal-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-8.1 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-jammy-maxcpus Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-bionic-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-mantic-hpb Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-artful Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-8.1 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-2.7 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-6.1 Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-kinetic Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-jammy-maxcpus Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-i440fx-yakkety Jul 05 03:27:58.879731 np0000004562 nova-compute[99148]: pc-q35-2.4 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-cosmic-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-7.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-2.10 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: x-remote Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-5.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-2.9 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-2.11 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-jammy-hpb-maxcpus Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-3.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-6.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-4.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-jammy Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-2.4 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-4.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-eoan Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-jammy-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-5.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-2.9 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-bionic-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-lunar Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: isapc Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-mantic-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-cosmic Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-2.6 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-mantic-maxcpus Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-3.1 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-bionic Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-disco-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-cosmic Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-2.12 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-bionic Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-kinetic-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-groovy-hpb Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-7.0 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-q35-noble-v2 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: ubuntu-q35 Jul 05 03:27:58.880408 np0000004562 nova-compute[99148]: pc-i440fx-lunar-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-disco Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-cosmic-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-noble Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: q35 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-2.1 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-8.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-impish Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-wily Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-8.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-2.6 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-6.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-impish Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-jammy Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-impish-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-hirsute Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-4.0.1 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-hirsute-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-7.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-5.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-2.8 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-2.10 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-3.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-6.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-zesty Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-7.2 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-4.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-focal Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: microvm Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-2.3 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-jammy-hpb-maxcpus Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-q35-8.2 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: q35 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-kinetic-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-focal-hpb Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-4.0 Jul 05 03:27:58.881187 np0000004562 nova-compute[99148]: pc-i440fx-noble Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-disco Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-groovy-hpb Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-8.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-hirsute-hpb Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-5.0 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-q35-6.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-2.8 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-eoan Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-q35-2.5 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-3.0 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-q35-yakkety Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-mantic-hpb-maxcpus Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-i440fx-7.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: pc-q35-2.11 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-m68k Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: mcf5208evb Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-7.0 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: an5206 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-6.0 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: q800 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-8.1 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-7.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-6.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-8.0 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: next-cube Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-7.1 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-6.1 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.881916 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-microblaze Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: petalogix-s3adsp1800 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: petalogix-ml605 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: xlnx-zynqmp-pmu Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-microblazeel Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: petalogix-s3adsp1800 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: petalogix-ml605 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: xlnx-zynqmp-pmu Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: mipssim Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mipsel Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: mipssim Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.882849 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips64 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: mipssim Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: pica61 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: magnum Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips64el Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: loongson3-virt Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: mipssim Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: pica61 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: magnum Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: boston Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: fuloong2e Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: g3beige Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: amigaone Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: virtex-ml507 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: mac99 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: ppce500 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: sam460ex Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: pegasos2 Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: bamboo Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: 40p Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: ref405ep Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: mpc8544ds Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.884179 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-noble Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: amigaone Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: powernv9 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: powernv Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-4.1 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: mpc8544ds Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-6.1 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-2.5 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: powernv10 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-xenial Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-4.2 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-6.2 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-yakkety Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-2.6 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: ppce500 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-bionic-sxxm Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-2.7 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-3.0 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-8.0 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-5.0 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: 40p Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-lunar Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-2.8 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pegasos2 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-hirsute Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-3.1 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-8.1 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-5.1 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-eoan Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-2.9 Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-zesty Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: bamboo Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-groovy Jul 05 03:27:58.885398 np0000004562 nova-compute[99148]: pseries-focal Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: g3beige Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-8.2 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-5.2 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-disco Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.12-sxxm Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-mantic Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-kinetic Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.10 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-7.0 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: virtex-ml507 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.11 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.1 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-7.1 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-cosmic Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-bionic Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.12 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.2 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-7.2 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: mac99 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-impish Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-jammy Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-artful Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: sam460ex Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: ref405ep Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.3 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: powernv8 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-4.0 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-6.0 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-2.4 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64le Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries-noble Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: pseries Jul 05 03:27:58.886259 np0000004562 nova-compute[99148]: amigaone Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: powernv9 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: powernv Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-4.1 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: mpc8544ds Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-6.1 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.5 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: powernv10 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-xenial Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-4.2 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-6.2 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-yakkety Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.6 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: ppce500 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-bionic-sxxm Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.7 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-3.0 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-8.0 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-5.0 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: 40p Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-lunar Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.8 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pegasos2 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-hirsute Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-3.1 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-8.1 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-5.1 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-eoan Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.9 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-zesty Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: bamboo Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-groovy Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-focal Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: g3beige Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-8.2 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-5.2 Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-disco Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-2.12-sxxm Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-mantic Jul 05 03:27:58.887169 np0000004562 nova-compute[99148]: pseries-kinetic Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.10 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-7.0 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: virtex-ml507 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.11 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.1 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-7.1 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-cosmic Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-bionic Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.12 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.2 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-7.2 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: mac99 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-impish Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-jammy Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-artful Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: sam460ex Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: ref405ep Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.3 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: powernv8 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-4.0 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-6.0 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: pseries-2.4 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-riscv32 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: spike Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: opentitan Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: sifive_u Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: sifive_e Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.887972 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-riscv64 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: spike Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: microchip-icicle-kit Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: sifive_u Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: shakti_c Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: sifive_e Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-s390x Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-noble Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-8.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-disco Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-6.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.11 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-7.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-mantic Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-xenial Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-5.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-focal Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.8 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-4.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-zesty Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-8.2 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-6.2 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-3.0 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-groovy Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.5 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-7.2 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-5.2 Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-artful Jul 05 03:27:58.888999 np0000004562 nova-compute[99148]: s390-ccw-virtio-hirsute Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-4.2 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.10 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.7 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-lunar Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-eoan Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-kinetic Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-8.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-yakkety Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-6.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-cosmic Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-bionic Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.12 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-7.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.4 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-5.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.9 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-impish Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-4.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-jammy Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-3.1 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: s390-ccw-virtio-2.6 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sh4 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: shix Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: r2d Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.889861 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sh4eb Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: shix Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: r2d Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sparc Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SS-5 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SS-20 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: LX Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SPARCClassic Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: leon3_generic Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SPARCbook Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SS-4 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SS-600MP Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: SS-10 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Voyager Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sparc64 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: sun4u Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: niagara Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: sun4v Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: 64 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: pc-i440fx-noble-v2 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: ubuntu Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: pc-q35-mantic Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: pc-i440fx-impish-hpb Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: pc-q35-5.2 Jul 05 03:27:58.891097 np0000004562 nova-compute[99148]: pc-q35-lunar-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-mantic Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-2.12 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-2.0 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-xenial Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-kinetic Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-6.2 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-4.2 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-mantic-maxcpus Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-2.5 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-4.2 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-focal Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-hirsute Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-xenial Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-jammy-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-5.2 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-2.7 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-eoan-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-zesty Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-groovy Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-disco-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-lunar Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-mantic-hpb-maxcpus Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-groovy Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-7.1 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-artful Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-trusty Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-2.2 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-focal-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-8.1 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-eoan-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-jammy-maxcpus Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-bionic-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-q35-mantic-hpb Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-artful Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-8.1 Jul 05 03:27:58.892593 np0000004562 nova-compute[99148]: pc-i440fx-2.7 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-6.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-kinetic Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-jammy-maxcpus Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-yakkety Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-2.4 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-cosmic-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-7.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-2.10 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: x-remote Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-5.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-2.9 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-2.11 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-jammy-hpb-maxcpus Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-3.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-6.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-4.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-jammy Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-2.4 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-4.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-eoan Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-jammy-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-5.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-2.9 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-bionic-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-lunar Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: isapc Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-mantic-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-cosmic Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-2.6 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-mantic-maxcpus Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-3.1 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-bionic Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-disco-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-cosmic Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-2.12 Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-i440fx-bionic Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-kinetic-hpb Jul 05 03:27:58.893313 np0000004562 nova-compute[99148]: pc-q35-groovy-hpb Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-7.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-noble-v2 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: ubuntu-q35 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-lunar-hpb Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-disco Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-cosmic-hpb Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-2.1 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-noble Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: q35 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-8.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-wily Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-impish Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-8.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-2.6 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-6.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-impish Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-jammy Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-impish-hpb Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-hirsute Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-4.0.1 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-hirsute-hpb Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-7.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-5.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-2.8 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-2.10 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-3.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-zesty Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-7.2 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-4.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-6.0 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-focal Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: microvm Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-2.3 Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-q35-jammy-hpb-maxcpus Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-disco Jul 05 03:27:58.894142 np0000004562 nova-compute[99148]: pc-i440fx-kinetic-hpb Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-4.0 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-focal-hpb Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-noble Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-q35-8.2 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: q35 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-groovy-hpb Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-hirsute-hpb Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-8.2 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-5.0 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-2.8 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-q35-6.2 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-eoan Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-q35-2.5 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-3.0 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-q35-yakkety Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-mantic-hpb-maxcpus Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-i440fx-7.2 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: pc-q35-2.11 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-xtensa Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: sim Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: kc705 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: ml605 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: ml605-nommu Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: lx60-nommu Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: lx200 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: lx200-nommu Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: lx60 Jul 05 03:27:58.894857 np0000004562 nova-compute[99148]: kc705-nommu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: hvm Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: 32 Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-xtensaeb Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: sim Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: kc705 Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: ml605 Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: ml605-nommu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: lx60-nommu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: lx200 Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: lx200-nommu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: lx60 Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: kc705-nommu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-alpha Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: clipper Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: alpha Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.895937 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: Jul 05 03:27:58.897032 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-arm Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: armv6l Jul 05 03:27:58.898653 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270-c0 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-a15 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270-b0 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-m4 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270-a0 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: arm1176 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270-b1 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-a7 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270-a1 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-a8 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-r5 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: ti925t Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-r5f Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: arm1026 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-a9 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: cortex-m7 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa270 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa260 Jul 05 03:27:58.899887 np0000004562 nova-compute[99148]: pxa250 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: pxa270-c5 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: pxa261 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: pxa262 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: sa1110 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cortex-r52 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: sa1100 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cortex-m0 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cortex-m33 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: arm946 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: pxa255 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: arm11mpcore Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cortex-m55 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: arm926 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: arm1136 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: arm1136-r2 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cortex-m3 Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.900706 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.901705 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: 2 Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: 3 Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-arm Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: armv6l Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: pxa270-c0 Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: cortex-a15 Jul 05 03:27:58.903182 np0000004562 nova-compute[99148]: pxa270-b0 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-m4 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa270-a0 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm1176 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa270-b1 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-a7 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa270-a1 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-a8 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-r5 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: ti925t Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-r5f Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm1026 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-a9 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-m7 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa270 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa260 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa250 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa270-c5 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa261 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa262 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: sa1110 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-r52 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: sa1100 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-m0 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-m33 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm946 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: pxa255 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm11mpcore Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: cortex-m55 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm926 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm1136 Jul 05 03:27:58.904348 np0000004562 nova-compute[99148]: arm1136-r2 Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: cortex-m3 Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: Jul 05 03:27:58.904894 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: 2 Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: 3 Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.906211 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-arm Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: armv7l Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: efi Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pxa270-c0 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-a15 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pxa270-b0 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-m4 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pxa270-a0 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: arm1176 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pxa270-b1 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-a7 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: pxa270-a1 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-a8 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-r5 Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: ti925t Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: cortex-r5f Jul 05 03:27:58.907687 np0000004562 nova-compute[99148]: arm1026 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-a9 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-m7 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa270 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa260 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa250 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa270-c5 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa261 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa262 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: sa1110 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-r52 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: sa1100 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-m0 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-m33 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: arm946 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: pxa255 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: arm11mpcore Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-m55 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: arm926 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: arm1136 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: arm1136-r2 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cortex-m3 Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: Jul 05 03:27:58.908873 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: Jul 05 03:27:58.909810 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: 2 Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: 3 Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-aarch64 Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: aarch64 Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: efi Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.911139 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: neoverse-n2 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270-c0 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a15 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270-b0 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a57 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-m4 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270-a0 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: arm1176 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270-b1 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a7 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270-a1 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a76 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: a64fx Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a8 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: neoverse-v1 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-r5 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: ti925t Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-r5f Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: arm1026 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-a9 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: cortex-m7 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa270 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa260 Jul 05 03:27:58.912228 np0000004562 nova-compute[99148]: pxa250 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: pxa270-c5 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: pxa261 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: pxa262 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-a710 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: sa1110 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-r52 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: sa1100 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-a53 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-m0 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-m33 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-a72 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: arm946 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: pxa255 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-a55 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: arm11mpcore Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-m55 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: neoverse-n1 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: arm926 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: arm1136 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-a35 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: arm1136-r2 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cortex-m3 Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.913045 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.913903 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: 2 Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: 3 Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-cris Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: axis-dev88 Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: cris Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.915151 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.916246 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-i386 Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: pc-q35-noble Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: i686 Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.917829 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:58.918837 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:58.920058 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.920876 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.921898 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: synic Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: reset Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: avic Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-i386 Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: pc-i440fx-noble-v2 Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: i686 Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: Jul 05 03:27:58.923275 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: Jul 05 03:27:58.924451 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:58.925348 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.925999 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.926906 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: synic Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: reset Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: avic Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-i386 Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: pc-q35-noble-v2 Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: i686 Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: Jul 05 03:27:58.928257 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.929479 np0000004562 nova-compute[99148]: Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:58.930529 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.931144 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: Jul 05 03:27:58.932021 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: synic Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: reset Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: avic Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-i386 Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: pc-i440fx-noble Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: i686 Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.933496 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.934861 np0000004562 nova-compute[99148]: Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:58.935813 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: Jul 05 03:27:58.936393 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.937229 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: synic Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: reset Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: avic Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-m68k Jul 05 03:27:58.938554 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: mcf5208evb Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: m68k Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.939660 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-m68k Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: virt-8.2 Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: m68k Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.941009 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: Jul 05 03:27:58.942213 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-microblaze Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: petalogix-s3adsp1800 Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: microblaze Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.943779 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.944846 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-microblazeel Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: petalogix-s3adsp1800 Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: microblazeel Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: Jul 05 03:27:58.946231 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.947278 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: mips Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.948755 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.949941 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mipsel Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: mipsel Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.951284 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.952399 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: Jul 05 03:27:58.953897 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips64 Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: mips64 Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.955084 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: Jul 05 03:27:58.956511 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-mips64el Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: malta Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: mips64el Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: Jul 05 03:27:58.958128 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.959238 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: g3beige Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: ppc Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.960676 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.961823 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64 Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: pseries-noble Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: ppc64 Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.963022 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: POWER10 Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: POWER9 Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: POWER8 Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: POWER7 Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.964148 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: tpm-spapr Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: spapr-tpm-proxy Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.965361 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: powernv9 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: ppc64 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: POWER10 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: POWER9 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: POWER8 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: POWER7 Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.966724 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: tpm-spapr Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: spapr-tpm-proxy Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.967818 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64 Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: pseries-noble Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: ppc64 Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.969082 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: POWER10 Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: POWER9 Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: POWER8 Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: POWER7 Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.970260 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: tpm-spapr Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: spapr-tpm-proxy Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.971512 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64le Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: powernv9 Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: ppc64le Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: POWER10 Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: POWER9 Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: POWER8 Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: POWER7 Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.972971 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: tpm-spapr Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: spapr-tpm-proxy Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.974370 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-ppc64le Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: pseries-noble Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: ppc64le Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: POWER10 Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: POWER9 Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: POWER8 Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: POWER7 Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.975788 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: Jul 05 03:27:58.976860 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: tpm-spapr Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: spapr-tpm-proxy Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-riscv32 Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.978137 np0000004562 nova-compute[99148]: riscv32 Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.979245 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.980899 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-riscv64 Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: virt Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: riscv64 Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: rv64 Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: sifive-e51 Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: any Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: x-rv128 Jul 05 03:27:58.982280 np0000004562 nova-compute[99148]: shakti-c Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: thead-c906 Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: sifive-u54 Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: veyron-v1 Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.983357 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: external Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: Jul 05 03:27:58.984741 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-s390x Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: s390-ccw-virtio-noble Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: s390x Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: on Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: off Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z13 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z990.3 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z13-base Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z990.2 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z196.2-base Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z14 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z14.2-base Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z990.4 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z196 Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z10BC.2-base Jul 05 03:27:58.985926 np0000004562 nova-compute[99148]: z114-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: gen16b Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z890.3-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: gen16a Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z990.5 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z196.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: zEC12 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: zEC12.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z9EC.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z9BC Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z9EC.3-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z800-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z14ZR1-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z890 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z990.4-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z9EC.3 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z13.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z10BC.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: gen15a-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z14.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: zBC12-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: gen16a-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z900.3 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z196-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z990 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z14-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z900.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z800 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z10EC Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z14ZR1 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z900 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z10EC.2 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z10EC.2-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z900.2-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z900-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z10EC.3 Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: z990.5-base Jul 05 03:27:58.987161 np0000004562 nova-compute[99148]: max Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: gen15b Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9BC.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: gen15a Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z990.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z10EC-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: gen16b-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z114 Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9EC-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z13s Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: gen15b-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: zEC12-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z890.3 Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z10EC.3-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z890.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z890.2 Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z10BC-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: zEC12.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z890-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9BC-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z10BC Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9EC Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9EC.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z13.2-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z900.3-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z990.3-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z13s-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: zBC12 Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z990-base Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: z9BC.2 Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.988094 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.988935 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sh4 Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: shix Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: sh4 Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.990303 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: Jul 05 03:27:58.991422 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sh4eb Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: shix Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: sh4eb Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.992745 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.993806 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sparc Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.995090 np0000004562 nova-compute[99148]: SS-5 Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: sparc Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.996135 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-sparc64 Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: sun4u Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: sparc64 Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.997527 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: rom Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: yes Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: no Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: file Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: disk Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: lun Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: ide Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: sata Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: spice Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: default Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:58.998547 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: optional Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: pci Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: random Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: egd Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: path Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: handle Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: usb Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: pty Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: unix Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: Jul 05 03:27:58.999856 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: pc-q35-noble Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: efi Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: /usr/share/ovmf/OVMF.amdsev.fd Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: on Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: off Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.001006 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:59.002078 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:59.002839 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.003454 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: external Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.004681 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: synic Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: reset Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: avic Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: pc-i440fx-noble-v2 Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: efi Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: on Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: off Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.006123 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:59.007187 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:59.007955 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: ide Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.008521 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: external Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.009687 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: synic Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: reset Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: avic Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: pc-q35-noble-v2 Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: efi Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: /usr/share/ovmf/OVMF.amdsev.fd Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: on Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: off Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.011008 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:59.012127 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:59.012947 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.013495 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: external Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: Jul 05 03:27:59.014445 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: synic Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: reset Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: avic Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: pc-i440fx-noble Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: efi Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: on Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: off Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.015777 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: AMD Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: qemu64 Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: qemu32 Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: phenom Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: pentium3 Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: pentium2 Jul 05 03:27:59.016988 np0000004562 nova-compute[99148]: pentium Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: n270 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: kvm64 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: kvm32 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: coreduo Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: core2duo Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: athlon Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Westmere-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Westmere Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Snowridge Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Server-noTSX-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Server-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Server Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Client-noTSX-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Client-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Skylake-Client Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: SapphireRapids Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: SandyBridge-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: SandyBridge Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Penryn Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Opteron_G5 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Opteron_G4 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Opteron_G3 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Opteron_G2 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Opteron_G1 Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Nehalem-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: IvyBridge-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: IvyBridge Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Icelake-Server-noTSX Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Icelake-Server Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Haswell-noTSX-IBRS Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Haswell-noTSX Jul 05 03:27:59.017755 np0000004562 nova-compute[99148]: Haswell-IBRS Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Haswell Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: EPYC-Rome Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: EPYC-Milan Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: EPYC-IBPB Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: EPYC-Genoa Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: EPYC Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Dhyana Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Cooperlake Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Conroe Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Cascadelake-Server-noTSX Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Cascadelake-Server Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Broadwell-noTSX-IBRS Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Broadwell-noTSX Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Broadwell-IBRS Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Broadwell Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: 486 Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: ide Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.018361 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: tpm-tis Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: tpm-crb Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: passthrough Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: emulator Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: external Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: 1.2 Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: 2.0 Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: Jul 05 03:27:59.019427 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: relaxed Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: vapic Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: spinlocks Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: vpindex Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: runtime Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: synic Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: stimer Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: reset Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: vendor_id Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: frequencies Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: reenlightenment Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: tlbflush Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: ipi Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: avic Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-xtensa Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: sim Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: xtensa Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: Jul 05 03:27:59.020794 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.021796 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=99148) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-xtensaeb Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.023079 np0000004562 nova-compute[99148]: sim Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: xtensaeb Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: rom Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: pflash Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: yes Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: no Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: file Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: anonymous Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: memfd Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: disk Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: cdrom Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: floppy Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: lun Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: fdc Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: sata Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: sdl Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: vnc Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: spice Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: egl-headless Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: dbus Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: subsystem Jul 05 03:27:59.024104 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: default Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: mandatory Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: requisite Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: optional Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: pci Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: scsi Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: virtio-transitional Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: virtio-non-transitional Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: random Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: egd Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: path Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: handle Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: virtiofs Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: usb Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: pty Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: unix Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: spicevmc Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: virtio Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: qemu Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: builtin Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: Jul 05 03:27:59.025501 np0000004562 nova-compute[99148]: {{(pid=99148) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 05 03:27:59.026643 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Checking secure boot support for host arch (x86_64) {{(pid=99148) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jul 05 03:27:59.026643 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Secure Boot support detected Jul 05 03:27:59.471430 np0000004562 nova-compute[99148]: INFO nova.virt.node [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Generated node identity 555a8dfa-6105-4c91-843c-764798128d3b Jul 05 03:27:59.471676 np0000004562 nova-compute[99148]: INFO nova.virt.node [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Wrote node identity 555a8dfa-6105-4c91-843c-764798128d3b to /opt/stack/data/nova/compute_id Jul 05 03:27:59.973946 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Compute nodes ['555a8dfa-6105-4c91-843c-764798128d3b'] for host np0000004562 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jul 05 03:27:59.974452 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Loading instances for host np0000004562 with expected_attrs: info_cache, metadata, system_metadata, numa_topology, flavor {{(pid=99148) init_host /opt/stack/nova/nova/compute/manager.py:1790}} Jul 05 03:28:00.476255 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Loaded 0 instances for host {{(pid=99148) init_host /opt/stack/nova/nova/compute/manager.py:1794}} Jul 05 03:28:00.978106 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jul 05 03:28:01.983110 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] No compute node record found for host np0000004562. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000004562 could not be found. Jul 05 03:28:01.983581 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:28:01.983581 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:28:01.983581 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:28:01.983768 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:28:02.057504 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:28:02.058584 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:28:02.073071 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:28:02.073549 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=55594MB free_disk=75.16276550292969GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:28:02.073748 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:28:02.073955 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:28:02.576982 np0000004562 nova-compute[99148]: WARNING nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] No compute node record for np0000004562:555a8dfa-6105-4c91-843c-764798128d3b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 555a8dfa-6105-4c91-843c-764798128d3b could not be found. Jul 05 03:28:03.081607 np0000004562 nova-compute[99148]: INFO nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Compute node record created for np0000004562:np0000004562 with uuid: 555a8dfa-6105-4c91-843c-764798128d3b Jul 05 03:28:04.588305 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:28:04.588858 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:28:02 up 24 min, 2 users, load average: 2.60, 1.60, 0.84\n'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:28:05.072892 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] [req-864d19b7-1afc-4012-8cf6-b1f2fa8e64c8] Created resource provider record via placement API for resource provider with UUID 555a8dfa-6105-4c91-843c-764798128d3b and name np0000004562. Jul 05 03:28:05.123067 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] /sys/module/kvm_amd/parameters/sev contains [N Jul 05 03:28:05.123067 np0000004562 nova-compute[99148]: ] {{(pid=99148) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jul 05 03:28:05.123226 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.host [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] kernel doesn't support AMD SEV Jul 05 03:28:05.123377 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:28:05.123550 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Updating inventory in ProviderTree for provider 555a8dfa-6105-4c91-843c-764798128d3b with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 05 03:28:05.123832 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Libvirt baseline CPU Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: x86_64 Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: AMD Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: Jul 05 03:28:05.128101 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13812}} Jul 05 03:28:05.692183 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Updated inventory for provider 555a8dfa-6105-4c91-843c-764798128d3b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:974}} Jul 05 03:28:05.692588 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Updating resource provider 555a8dfa-6105-4c91-843c-764798128d3b generation from 0 to 1 during operation: update_inventory {{(pid=99148) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jul 05 03:28:05.692588 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Updating inventory in ProviderTree for provider 555a8dfa-6105-4c91-843c-764798128d3b with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 05 03:28:05.823382 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Updating resource provider 555a8dfa-6105-4c91-843c-764798128d3b generation from 1 to 2 during operation: update_traits {{(pid=99148) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jul 05 03:28:06.330241 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:28:06.330457 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.256s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:28:06.330687 np0000004562 nova-compute[99148]: DEBUG nova.service [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=99148) start /opt/stack/nova/nova/service.py:196}} Jul 05 03:28:06.347807 np0000004562 nova-compute[99148]: DEBUG nova.service [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=99148) start /opt/stack/nova/nova/service.py:212}} Jul 05 03:28:06.363486 np0000004562 nova-compute[99148]: DEBUG nova.service [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] Join ServiceGroup membership for this service compute {{(pid=99148) start /opt/stack/nova/nova/service.py:222}} Jul 05 03:28:06.363793 np0000004562 nova-compute[99148]: DEBUG nova.servicegroup.drivers.db [None req-5798251d-a5f7-4d28-9505-dad8686aeee7 None None] DB_Driver: join new ServiceGroup member np0000004562 to the compute group, service = {{(pid=99148) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 05 03:28:11.867107 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:28:13.366075 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._sync_power_states {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:13.868929 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:13.869873 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.80 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:28:45.671000 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.671888 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.672410 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.672410 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.672782 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.672987 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.673531 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:45.673531 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:28:45.673848 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:28:46.178468 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:28:46.178468 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:28:46.178468 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:28:46.178468 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:28:46.186442 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:28:46.187265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:28:46.199734 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:28:46.200409 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=55329MB free_disk=75.07242965698242GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:28:46.200774 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:28:46.201115 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:28:47.260742 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:28:47.260742 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:28:46 up 25 min, 2 users, load average: 2.03, 1.60, 0.88\n'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:28:47.304165 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:28:47.304165 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:28:47.807747 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:28:48.311871 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:28:48.312653 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.111s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:28:48.313357 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:29:48.306858 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.307254 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.307421 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.307554 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.307805 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.308037 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.308301 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.308537 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.308687 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:29:48.308888 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:48.813844 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:48.813844 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:48.813844 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:48.813844 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:29:48.825158 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:29:48.826416 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:48.840432 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:48.840861 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=54847MB free_disk=74.96383285522461GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:29:48.841074 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:48.841427 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:49.912474 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:29:49.912847 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:29:48 up 26 min, 2 users, load average: 2.94, 1.86, 1.02\n'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:29:49.986048 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:29:49.986570 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:29:50.489468 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:29:50.721833 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:50.722072 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:50.995593 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:29:50.996164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.154s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:50.996164 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:29:51.224690 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:29:51.811026 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:51.811258 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:51.814624 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:29:51.815342 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Claim successful on node np0000004562 Jul 05 03:29:52.946985 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:29:52.947330 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:29:53.450145 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:29:53.961159 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.148s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:53.961159 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:29:54.471064 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:29:54.471064 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:29:54.471256 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:54.475840 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:54.618787 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:54.619026 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:54.979879 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:29:55.092705 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44a79361579241c6b5c3dabae6e495d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83ec28ff634978a83705e49f447e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:29:55.121764 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:29:55.318650 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:55.319236 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:55.484589 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:29:55.699512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:55.699706 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:55.707634 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:29:55.707799 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Claim successful on node np0000004562 Jul 05 03:29:55.789500 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Successfully created port: 7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:29:55.821772 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:29:56.375262 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:56.495884 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:29:56.497292 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:29:56.497547 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Creating image(s) Jul 05 03:29:56.498700 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "/opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:56.498910 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "/opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:56.499416 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "/opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:56.499797 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:56.500222 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:56.845164 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:56.848055 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:56.848396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:56.944041 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.part --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:56.944618 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] 0c8fa207-3de5-4489-a2c5-f4cc8559edb8 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:29:56.946828 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:29:56.946828 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.part /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:57.047683 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:29:57.048048 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:29:57.060417 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Successfully updated port: 7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:29:57.119115 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.part /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.converted" returned: 0 in 0.173s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:57.125518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:57.196122 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b.converted --force-share --output=json" returned: 0 in 0.071s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:57.197156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.697s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:57.197772 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:57.202664 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:57.203783 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_uc0_x6d/privsep.sock'] Jul 05 03:29:57.211321 np0000004562 sudo[110375]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_uc0_x6d/privsep.sock Jul 05 03:29:57.211976 np0000004562 sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:29:57.515520 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 03:29:57.515520 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:29:57.515520 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:29:57.515995 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 03:29:57.553244 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:29:57.565397 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:29:57.565583 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquired lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:29:57.565820 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:29:57.742141 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-changed-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:29:57.743239 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Refreshing instance network info cache due to event network-changed-7f677ae1-c458-46bf-bafc-95d08663076e. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:29:57.743239 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] Acquiring lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:29:57.871058 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 03:29:57.871151 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:29:57.871226 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:29:57.871344 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:29:57.871408 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:29:57.871483 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:29:57.871555 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:29:57.871623 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:29:57.871692 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 03:29:58.065696 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.366s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:58.066452 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:29:58.071044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.696s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:58.082649 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:29:58.082649 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Claim successful on node np0000004562 Jul 05 03:29:58.150559 np0000004562 sudo[110375]: pam_unix(sudo:session): session closed for user root Jul 05 03:29:58.152131 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Spawned new privsep daemon via rootwrap Jul 05 03:29:58.153309 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 03:29:58.153452 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 03:29:58.153505 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 03:29:58.153589 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110386 Jul 05 03:29:58.188387 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:29:58.253756 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:58.361971 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.108s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:58.363130 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:58.363622 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:58.364166 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:58.371961 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:29:58.372512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:58.456389 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:58.460472 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:58.496807 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk 1073741824" returned: 0 in 0.038s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:58.497318 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.134s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:58.497678 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:58.578900 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:29:58.579170 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:29:58.583739 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:58.583739 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:58.586885 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:58.587445 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:29:58.587857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:29:58.616453 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:58.671932 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Cannot resize image /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Ensure instance console log exists: /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:58.673558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:58.713133 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87700afdc5b8465bb1fb235e2ebf6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3465ef2c67b48a5a9eeb4bea4ff9fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:29:58.800316 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Updating instance_info_cache with network_info: [{"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:29:59.085019 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:29:59.305179 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Releasing lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:29:59.305588 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Instance network_info: |[{"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:29:59.305967 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] Acquired lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:29:59.306119 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Refreshing network info cache for port 7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:29:59.309689 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Start _get_guest_xml network_info=[{"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:29:59.314996 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:29:59.317804 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1867295979', uuid='449dfef2-349e-4d2f-bf24-c52969269a1c'), owner=OwnerMeta(userid='44a79361579241c6b5c3dabae6e495d7', username='tempest-DeleteServersTestJSON-714661285-project-member', projectid='3a83ec28ff634978a83705e49f447e85', projectname='tempest-DeleteServersTestJSON-714661285'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222199.3171568) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:29:59.323905 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:29:59.324880 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:29:59.325105 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:29:59.326591 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:29:59.327393 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:29:59.327593 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:29:59.328962 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:29:59.329347 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:29:59.329486 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:29:59.329612 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:29:59.329857 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:29:59.330049 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:29:59.330142 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:29:59.330330 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:29:59.330425 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:29:59.330528 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:29:59.330641 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:29:59.330811 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:29:59.344660 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:29:59.345706 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1867295979',display_name='tempest-DeleteServersTestJSON-server-1867295979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-deleteserverstestjson-server-1867295979',id=1,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a83ec28ff634978a83705e49f447e85',ramdisk_id='',reservation_id='r-92886ed0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-714661285',owner_user_name='tempest-DeleteServersTestJSON-714661285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:29:56Z,user_data=None,user_id='44a79361579241c6b5c3dabae6e495d7',uuid=449dfef2-349e-4d2f-bf24-c52969269a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:29:59.346259 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converting VIF {"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:29:59.347683 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:29:59.349771 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lazy-loading 'pci_devices' on Instance uuid 449dfef2-349e-4d2f-bf24-c52969269a1c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:29:59.588833 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:29:59.808868 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:29:59.831250 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] End _get_guest_xml xml= Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 449dfef2-349e-4d2f-bf24-c52969269a1c Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: instance-00000001 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 196608 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 1 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: tempest-DeleteServersTestJSON-server-1867295979 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 2026-07-05 03:29:59 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 192 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 1 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 0 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 0 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 1 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: True Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: bare Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 1 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 0 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: virtio Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: tempest-DeleteServersTestJSON-714661285-project-member Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: tempest-DeleteServersTestJSON-714661285 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 449dfef2-349e-4d2f-bf24-c52969269a1c Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 449dfef2-349e-4d2f-bf24-c52969269a1c Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: hvm Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 128 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: 1 Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Preparing to wait for external event network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:29:59.855242 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:29:59.857647 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:29:59.861614 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1867295979',display_name='tempest-DeleteServersTestJSON-server-1867295979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-deleteserverstestjson-server-1867295979',id=1,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a83ec28ff634978a83705e49f447e85',ramdisk_id='',reservation_id='r-92886ed0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-714661285',owner_user_name='tempest-DeleteServersTestJSON-714661285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:29:56Z,user_data=None,user_id='44a79361579241c6b5c3dabae6e495d7',uuid=449dfef2-349e-4d2f-bf24-c52969269a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:29:59.861614 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converting VIF {"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:29:59.862149 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:29:59.862732 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:29:59.913786 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Created schema index Interface.name {{(pid=99148) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 05 03:29:59.914006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Created schema index Port.name {{(pid=99148) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 05 03:29:59.914151 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Created schema index Bridge.name {{(pid=99148) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 05 03:29:59.915831 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=99148) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jul 05 03:29:59.916063 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [POLLOUT] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.916487 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=99148) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jul 05 03:29:59.917135 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.946561 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Successfully created port: a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:29:59.976520 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.976788 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:29:59.977006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:29:59.978841 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.979108 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd8df375-f321-52f6-8e47-d1e918b43171', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:29:59.980587 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.980963 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:29:59.982504 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpa52ekd7g/privsep.sock'] Jul 05 03:29:59.992757 np0000004562 sudo[110441]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpa52ekd7g/privsep.sock Jul 05 03:29:59.994036 np0000004562 sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:30:00.288008 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 03:30:00.288152 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:30:00.288432 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:30:00.288432 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:00.288432 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:30:00.288432 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:30:00.288432 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:30:00.288589 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:00.288589 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 03:30:00.349596 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.275s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:00.349596 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:00.399294 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:00.602775 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:00.602775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:00.602775 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Creating image(s) Jul 05 03:30:00.602775 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:00.602775 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:00.604165 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:00.604839 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:00.608303 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:00.609953 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:00.669281 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 03:30:00.669372 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:30:00.669418 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:30:00.669458 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:00.669541 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:30:00.669590 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:30:00.669628 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:30:00.669666 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:00.669703 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 03:30:00.689090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.079s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:00.690746 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:00.690839 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:00.691424 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:00.701110 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:00.702668 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:00.703445 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:00.786979 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:00.787686 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:00.836772 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk 1073741824" returned: 0 in 0.048s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:00.837091 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.146s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:00.837439 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:00.861680 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:00.862219 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:00.862768 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:00.863246 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:00.887471 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Updated VIF entry in instance network info cache for port 7f677ae1-c458-46bf-bafc-95d08663076e. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:00.888005 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Updating instance_info_cache with network_info: [{"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:00.909849 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.072s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:00.910308 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:00.910545 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:00.916213 np0000004562 sudo[110441]: pam_unix(sudo:session): session closed for user root Jul 05 03:30:00.919140 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Spawned new privsep daemon via rootwrap Jul 05 03:30:00.921068 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 03:30:00.921177 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 03:30:00.921759 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jul 05 03:30:00.921759 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110474 Jul 05 03:30:00.953356 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f75c839862741bda4735a21795759ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026b2963073e4b6ca4fa964dbc89d833', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Cannot resize image /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Ensure instance console log exists: /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:00.984334 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:01.010274 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Successfully updated port: a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:01.246375 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:01.246375 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f677ae1-c4, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:01.246623 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f677ae1-c4, col_values=(('qos', UUID('6da5a87b-fa95-4396-840a-b08b0da490a4')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:01.247508 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f677ae1-c4, col_values=(('external_ids', {'iface-id': '7f677ae1-c458-46bf-bafc-95d08663076e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ac:1c', 'vm-uuid': '449dfef2-349e-4d2f-bf24-c52969269a1c'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:01.249745 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:01.255008 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:01.262551 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:01.270974 np0000004562 nova-compute[99148]: INFO os_vif [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') Jul 05 03:30:01.287644 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:01.289070 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:01.364953 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:01.393105 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-be49197c-29e6-49f9-b3b6-3b061cc8c29c req-467c69f0-e595-4b6d-a798-44a6967bb21f service nova] Releasing lock "refresh_cache-449dfef2-349e-4d2f-bf24-c52969269a1c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:01.512406 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:01.512525 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:01.512699 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:01.872409 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:02.314280 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:02.487019 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-changed-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:02.487700 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Refreshing instance network info cache due to event network-changed-a925ff58-8914-48a7-8301-62b925285161. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:02.487700 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] Acquiring lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:02.613942 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Successfully created port: 8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:02.763757 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:02.809297 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:02.810126 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:02.810126 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No VIF found with MAC fa:16:3e:28:ac:1c, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:02.810546 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Using config drive Jul 05 03:30:02.892841 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:02.894109 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:02.894534 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Creating image(s) Jul 05 03:30:02.896780 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:02.897026 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:02.897804 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:02.899117 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:02.903491 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:02.905482 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:02.990624 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:02.992407 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:02.992407 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:02.992407 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:02.999062 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:02.999661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:03.063148 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.063s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:03.063824 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:03.090096 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk 1073741824" returned: 0 in 0.026s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:03.090878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.099s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:03.091368 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:03.115562 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:03.155857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.063s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:03.155857 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:03.155857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:03.241273 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:03.241727 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Cannot resize image /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:03.242473 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:03.242889 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Ensure instance console log exists: /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:03.243353 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:03.243597 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:03.244238 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:03.323738 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:03.452686 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Successfully updated port: 8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:03.496950 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-changed-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:03.497578 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Refreshing instance network info cache due to event network-changed-8c91f432-9afa-42c0-95c5-81ebf116e5e9. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:03.497780 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:03.497882 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:03.498022 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Refreshing network info cache for port 8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:03.755338 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Updating instance_info_cache with network_info: [{"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:03.956074 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:04.000249 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:04.173536 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.183396 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.185873 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.187395 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.204815 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.248426 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Creating config drive at /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.config Jul 05 03:30:04.253357 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_k_td4u0 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:04.265078 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:04.265731 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Instance network_info: |[{"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:04.266147 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] Acquired lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:04.266613 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Refreshing network info cache for port a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:04.270169 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Start _get_guest_xml network_info=[{"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:04.274549 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:04.276418 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-592721547', uuid='d22f1b3c-5d43-486e-a417-325d749fca25'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222204.2755382) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:04.280684 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_k_td4u0" returned: 0 in 0.027s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:04.281293 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:04.281740 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:04.285041 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:04.285497 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:04.286985 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:04.286985 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:04.287175 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:04.287277 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:04.287670 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:04.287670 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:04.288508 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:04.288508 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:04.288508 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:04.288508 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:04.290598 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:04.291211 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:04.308756 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:04.315471 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592721547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-592721547',id=2,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-0ar0jo0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:00Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=d22f1b3c-5d43-486e-a417-325d749fca25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:04.316159 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:04.316950 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:04.318401 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid d22f1b3c-5d43-486e-a417-325d749fca25 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:04.484420 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:04.730307 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.736565 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.775510 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] End _get_guest_xml xml= Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: d22f1b3c-5d43-486e-a417-325d749fca25 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: instance-00000002 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-592721547 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 2026-07-05 03:30:04 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: True Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: bare Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: d22f1b3c-5d43-486e-a417-325d749fca25 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: d22f1b3c-5d43-486e-a417-325d749fca25 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: Jul 05 03:30:04.823839 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:04.825913 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Preparing to wait for external event network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:04.825913 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:04.825913 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:04.825913 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:04.827363 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592721547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-592721547',id=2,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-0ar0jo0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:00Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=d22f1b3c-5d43-486e-a417-325d749fca25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:04.827872 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:04.828652 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:04.831037 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:04.832695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.832695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:04.832695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:04.834968 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.834968 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac0570ab-4d1d-5919-9c3a-5d4be78f36d8', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:04.836113 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.836113 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:04.840704 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.846188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.846188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa925ff58-89, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:04.846188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa925ff58-89, col_values=(('qos', UUID('8f8210fe-2492-43ec-8c78-b074feadfab4')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:04.846188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa925ff58-89, col_values=(('external_ids', {'iface-id': 'a925ff58-8914-48a7-8301-62b925285161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:99:45', 'vm-uuid': 'd22f1b3c-5d43-486e-a417-325d749fca25'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:04.848847 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.848847 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:04.854158 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.860339 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.864626 np0000004562 nova-compute[99148]: INFO os_vif [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') Jul 05 03:30:04.888346 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:04.987424 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-50e7a579-fee5-483b-9a77-c597c0636ddc req-2e4ccf6b-eb5e-4ade-8118-5244d88a3de8 service nova] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:04.987424 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:04.987424 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:05.228040 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:05.231216 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:05.249799 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:05.249988 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:05.364857 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:05.635703 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:05.675341 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:05.675653 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] VM Started (Lifecycle Event) Jul 05 03:30:05.698519 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Updated VIF entry in instance network info cache for port a925ff58-8914-48a7-8301-62b925285161. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:05.698863 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Updating instance_info_cache with network_info: [{"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:05.742867 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:05.877325 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:05.986290 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:06.112757 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:06.177898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:06.186068 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:06.186068 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] VM Paused (Lifecycle Event) Jul 05 03:30:06.201095 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f622e35-6800-42c8-b043-ab754b87bb26 req-db4c60e6-835d-4716-b9b6-cd6eaf5dd283 service nova] Releasing lock "refresh_cache-d22f1b3c-5d43-486e-a417-325d749fca25" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:06.248316 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:06.403368 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:06.403368 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:06.403368 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:1d:99:45, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:06.403368 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Using config drive Jul 05 03:30:06.614658 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:06.615048 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance network_info: |[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:06.618062 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start _get_guest_xml network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:06.621073 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:06.622470 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-677853189', uuid='56f86925-1417-4995-8ffe-d5c410bc7613'), owner=OwnerMeta(userid='5f75c839862741bda4735a21795759ce', username='tempest-ServerActionsTestOtherB-2067268672-project-member', projectid='026b2963073e4b6ca4fa964dbc89d833', projectname='tempest-ServerActionsTestOtherB-2067268672'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222206.622091) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:06.623789 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:06.624189 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:06.625348 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:06.625639 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:06.626632 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:06.627044 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:06.627261 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:06.627389 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:06.627567 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:06.627676 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:06.627994 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:06.628052 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:06.628139 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:06.628305 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:06.628437 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:06.628588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:06.646297 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:06.646621 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:06.649791 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:06.649791 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'pci_devices' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:06.686795 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:06.690857 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:06.909941 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:06.928113 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:06.928626 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:07.081535 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:07.081755 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:07.123562 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Creating config drive at /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.config Jul 05 03:30:07.128872 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpil2khvd7 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] End _get_guest_xml xml= Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: instance-00000003 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-server-677853189 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 2026-07-05 03:30:06 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: True Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: bare Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672-project-member Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: Jul 05 03:30:07.152638 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:07.154777 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Preparing to wait for external event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:07.154777 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:07.154777 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:07.154777 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:07.154777 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:07.155000 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:07.155491 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:07.155928 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:07.157155 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.157155 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:07.157155 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:07.158164 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.158164 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '378c4ad4-9eda-5c54-b6ef-0de45d9ad0aa', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:07.159110 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.159458 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:07.160167 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpil2khvd7" returned: 0 in 0.031s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:07.160485 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.162878 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.163462 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c91f432-9a, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:07.163462 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c91f432-9a, col_values=(('qos', UUID('5485eaf2-2d9d-4c3a-9121-9d92d2386153')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:07.163819 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c91f432-9a, col_values=(('external_ids', {'iface-id': '8c91f432-9afa-42c0-95c5-81ebf116e5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:da:ea', 'vm-uuid': '56f86925-1417-4995-8ffe-d5c410bc7613'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:07.167209 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.169199 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:07.175044 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.180753 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.194984 np0000004562 nova-compute[99148]: INFO os_vif [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:30:07.195703 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:07.211059 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.265511 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d9c62259-6cdc-454b-b800-a019b432730b req-c38ad3d0-fcc5-42fa-91f6-6a7bb851f4b4 service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:07.265697 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d9c62259-6cdc-454b-b800-a019b432730b req-c38ad3d0-fcc5-42fa-91f6-6a7bb851f4b4 service nova] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:07.265877 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d9c62259-6cdc-454b-b800-a019b432730b req-c38ad3d0-fcc5-42fa-91f6-6a7bb851f4b4 service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:07.266002 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d9c62259-6cdc-454b-b800-a019b432730b req-c38ad3d0-fcc5-42fa-91f6-6a7bb851f4b4 service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:07.266141 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d9c62259-6cdc-454b-b800-a019b432730b req-c38ad3d0-fcc5-42fa-91f6-6a7bb851f4b4 service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Processing event network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:07.266880 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:07.269762 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:07.269895 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] VM Resumed (Lifecycle Event) Jul 05 03:30:07.271696 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:07.281118 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Instance spawned successfully. Jul 05 03:30:07.282447 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:07.433111 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:07.533553 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.546420 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.563561 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.585150 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:07.655558 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.661888 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:07.772691 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:07.774400 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:07.789603 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.789765 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.790159 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.790444 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.791032 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.791097 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:07.999765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:07.999939 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:08.003138 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:08.003383 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Claim successful on node np0000004562 Jul 05 03:30:08.142969 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:08.276577 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:08.297923 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Took 11.80 seconds to spawn the instance on the hypervisor. Jul 05 03:30:08.299898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:08.391986 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:08.560457 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:08.560573 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] VM Started (Lifecycle Event) Jul 05 03:30:08.717482 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:08.717482 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:08.717482 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No VIF found with MAC fa:16:3e:0f:da:ea, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:08.718497 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Using config drive Jul 05 03:30:08.808859 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Took 17.08 seconds to build instance. Jul 05 03:30:09.065021 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:09.066939 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:09.066939 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] VM Paused (Lifecycle Event) Jul 05 03:30:09.223575 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:09.310965 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5eb0325e-3374-4580-ba97-21ef7f4574f7 tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.588s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:09.348749 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:09.349081 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:09.386405 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:09.386671 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:09.387341 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:09.387510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:09.387751 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] No waiting events found dispatching network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:09.388356 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-734bb8e7-287e-428f-8e93-cc58aa8a7984 req-50bce7d0-ade4-4faf-a283-b2095dcb69d0 service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received unexpected event network-vif-plugged-7f677ae1-c458-46bf-bafc-95d08663076e for instance with vm_state active and task_state None. Jul 05 03:30:09.432127 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Creating config drive at /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config Jul 05 03:30:09.436098 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5mryoe08 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:09.461116 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5mryoe08" returned: 0 in 0.025s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:09.569702 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:09.571403 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:09.854130 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:09.930397 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:10.074143 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:10.328213 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:10.328575 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:10.372875 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.372s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:10.378683 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:10.381110 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.238s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:10.385378 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:10.385378 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Claim successful on node np0000004562 Jul 05 03:30:10.488967 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:10.715339 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:10.715339 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Started (Lifecycle Event) Jul 05 03:30:10.837010 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lazy-loading 'flavor' on Instance uuid 449dfef2-349e-4d2f-bf24-c52969269a1c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:10.898385 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:10.898760 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:10.899599 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:10.899599 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:11.019252 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdc3b878cf1442c3bdb97246e4cfa3f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18996417885c4ff8b2c6ec2fa2563e43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:11.217703 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:11.220205 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:11.220315 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Paused (Lifecycle Event) Jul 05 03:30:11.250444 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:11.402838 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:11.507941 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Successfully created port: 916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:11.723982 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:11.726092 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:11.779341 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:11.779598 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:11.846778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:11.869483 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:30:11.906818 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:12.099589 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Successfully updated port: 916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:12.171898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-changed-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:12.172270 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:12.172624 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Refreshing instance network info cache due to event network-changed-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:12.172923 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] Acquiring lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:12.173219 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] Acquired lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:12.173249 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Refreshing network info cache for port 916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:12.230312 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:12.258444 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:12.258697 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:12.284772 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:12.293753 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:12.293955 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:12.602439 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:12.675930 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:12.748857 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:12.761024 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:12.789853 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.409s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:12.790272 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:12.796968 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:12.921509 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:12.922780 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:12.923076 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Creating image(s) Jul 05 03:30:12.923813 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:12.924047 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "/opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:12.924751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "/opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:12.925300 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:12.929021 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:12.930370 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:12.956931 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:13.012791 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.082s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:13.018941 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:13.019450 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.005s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:13.019927 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:13.022700 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:13.023012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:13.101411 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.078s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:13.101621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:13.134787 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk 1073741824" returned: 0 in 0.033s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:13.135202 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.116s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:13.135487 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:13.198522 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.062s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:13.198895 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:13.199011 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:13.273991 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:13.274530 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Cannot resize image /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:13.274940 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:13.275117 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Ensure instance console log exists: /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:13.275421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:13.275650 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:13.277220 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:13.298338 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:13.298423 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:13.298739 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:13.299018 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:13.368869 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:13.369119 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:13.375783 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:13.376302 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Claim successful on node np0000004562 Jul 05 03:30:13.382563 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:13.447605 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fc9d8d23e4a43009ede6e0b2291c365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f15da77ec4e4a65bcdd563097de4c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:13.461027 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b99fea9-8ac5-4d5d-bbc4-588881f3852f req-90e40fe3-2bc7-4681-a891-c45fea96ba0f service nova] Releasing lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:13.461580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquired lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:13.461774 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:13.475882 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:13.476101 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:13.477432 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Attaching volume 6da48ae1-2bec-4a9e-a5e2-81d6bd434044 to /dev/vdb Jul 05 03:30:13.560685 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:13.561340 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpk4ejolfb/privsep.sock'] Jul 05 03:30:13.569268 np0000004562 sudo[111256]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpk4ejolfb/privsep.sock Jul 05 03:30:13.570064 np0000004562 sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:30:13.803726 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jul 05 03:30:13.827775 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 03:30:13.827950 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:30:13.828007 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:30:13.828049 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:13.828087 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:30:13.828122 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:30:13.828168 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:30:13.828250 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:13.828292 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 03:30:14.048965 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:14.156285 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 03:30:14.156403 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:30:14.156441 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:30:14.156528 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:14.156607 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:30:14.157577 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:30:14.157577 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:30:14.157577 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:30:14.157577 np0000004562 nova-compute[99148]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 03:30:14.290350 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:14.307302 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:14.375638 np0000004562 sudo[111256]: pam_unix(sudo:session): session closed for user root Jul 05 03:30:14.377965 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Successfully created port: 0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:14.379087 np0000004562 nova-compute[99148]: INFO oslo.privsep.daemon [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Spawned new privsep daemon via rootwrap Jul 05 03:30:14.521645 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updating instance_info_cache with network_info: [{"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:14.537131 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:30:14.537621 np0000004562 nova-compute[99148]: WARNING os_brick.initiator.connectors.nvmeof [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 05 03:30:14.560120 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:14.582532 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:30:14.582846 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:30:14.592967 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:30:14.594593 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe28:ac1c', 'fe80::54ab:34ff:fe17:e790', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327'] Jul 05 03:30:14.594772 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:30:14.594824 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:30:14.595609 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] <== get_connector_properties: return (1034ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:14.595937 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Updating existing volume attachment record: 7e562bf5-1ea7-4c3d-bd20-3bb14a00b35d {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:30:14.851497 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:14.851900 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:15.020772 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Successfully updated port: 0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:15.024285 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Releasing lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:15.024742 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance network_info: |[{"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:15.026500 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Start _get_guest_xml network_info=[{"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:15.028079 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:15.029293 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-627436530', uuid='d5282468-599f-4af3-b640-af72408dd7d6'), owner=OwnerMeta(userid='bdc3b878cf1442c3bdb97246e4cfa3f7', username='tempest-VolumesAssistedSnapshotsTest-632308792-project-member', projectid='18996417885c4ff8b2c6ec2fa2563e43', projectname='tempest-VolumesAssistedSnapshotsTest-632308792'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222215.0289228) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:15.030261 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:15.030696 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:15.031617 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:15.031860 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:15.033021 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:15.033686 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:15.033817 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:15.034005 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:15.034244 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:15.034415 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:15.034600 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:15.034868 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:15.035035 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:15.035253 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:15.035414 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:15.035610 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:15.048520 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-627436530',display_name='tempest-VolumesAssistedSnapshotsTest-server-627436530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesassistedsnapshotstest-server-627436530',id=4,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OoV2DIPcCWbVfrzoMxevD7ldzcybircMn/uLCiAkAM10v93ROCeRf3XZraDd03T/5uVN+hnNvrj27sTDMje3XCA0IqNUvb9cnIGQMZgdEDPayx9sZHcZ+6Lj+jH6bGg==',key_name='tempest-keypair-1780835719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18996417885c4ff8b2c6ec2fa2563e43',ramdisk_id='',reservation_id='r-lznorq0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-632308792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-632308792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdc3b878cf1442c3bdb97246e4cfa3f7',uuid=d5282468-599f-4af3-b640-af72408dd7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:15.048754 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converting VIF {"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:15.049446 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:15.050083 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lazy-loading 'pci_devices' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:15.190377 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:15.190540 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:15.192431 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connector [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Factory for ISCSI on None {{(pid=99148) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:30:15.192628 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:15.192795 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:30:15.193098 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:15.193364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:15.193950 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:15.194657 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:30:15.206065 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:15.206769 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:15.207418 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:15.207746 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:15.208112 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:15.208328 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:15.220384 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:15.220384 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:15.228446 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:15.228446 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044] added Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:15.236018 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:15.236299 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:15.236368 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:15.236542 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044] added Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:15.239456 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:15.239699 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:15.239904 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:15.320610 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:15.321797 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:15.322073 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Creating image(s) Jul 05 03:30:15.322662 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "/opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:15.323870 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "/opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:15.324439 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "/opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:15.324837 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:15.326443 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:15.357332 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:15.524565 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:15.524705 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquired lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:15.524890 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] End _get_guest_xml xml= Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: d5282468-599f-4af3-b640-af72408dd7d6 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: instance-00000004 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: tempest-VolumesAssistedSnapshotsTest-server-627436530 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 2026-07-05 03:30:15 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: True Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: bare Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: tempest-VolumesAssistedSnapshotsTest-632308792-project-member Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: tempest-VolumesAssistedSnapshotsTest-632308792 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: d5282468-599f-4af3-b640-af72408dd7d6 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: d5282468-599f-4af3-b640-af72408dd7d6 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: Jul 05 03:30:15.554243 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:15.556570 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Preparing to wait for external event network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:15.556570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:15.556570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:15.556570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:15.556570 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-627436530',display_name='tempest-VolumesAssistedSnapshotsTest-server-627436530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesassistedsnapshotstest-server-627436530',id=4,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OoV2DIPcCWbVfrzoMxevD7ldzcybircMn/uLCiAkAM10v93ROCeRf3XZraDd03T/5uVN+hnNvrj27sTDMje3XCA0IqNUvb9cnIGQMZgdEDPayx9sZHcZ+6Lj+jH6bGg==',key_name='tempest-keypair-1780835719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18996417885c4ff8b2c6ec2fa2563e43',ramdisk_id='',reservation_id='r-lznorq0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-632308792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-632308792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdc3b878cf1442c3bdb97246e4cfa3f7',uuid=d5282468-599f-4af3-b640-af72408dd7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:15.556899 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converting VIF {"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:15.557531 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:15.557782 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:15.558236 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.558552 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:15.558901 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:15.559621 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.559913 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bdcb407-fb06-5617-9d51-4a6aca3a2b91', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:15.560925 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.561609 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:15.565238 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.571920 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.571920 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap916d9fcb-aa, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:15.571920 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap916d9fcb-aa, col_values=(('qos', UUID('35d253b3-7c69-4669-b864-e7320a66d176')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:15.571920 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap916d9fcb-aa, col_values=(('external_ids', {'iface-id': '916d9fcb-aaf2-43c0-afeb-c4d5111c84eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e8:7f', 'vm-uuid': 'd5282468-599f-4af3-b640-af72408dd7d6'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:15.572589 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.574200 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:15.580863 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.587265 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.608924 np0000004562 nova-compute[99148]: INFO os_vif [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') Jul 05 03:30:15.614126 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.623730 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.628837 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-changed-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:15.629017 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Refreshing instance network info cache due to event network-changed-0783e26a-b86f-4c47-9d34-e5257070756f. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:15.629199 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] Acquiring lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:15.864886 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.496s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:15.865477 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.484s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:15.865748 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:15.869776 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:15.869913 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Claim successful on node np0000004562 Jul 05 03:30:15.969214 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.972908 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.976895 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:15.992480 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:16.106513 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:16.237202 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:16.240365 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:16.251774 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:16.259783 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:16.262532 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.269758 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:16.276131 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.279969 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.280135 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.280598 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.281135 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: WARNING os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:30:16.293018 np0000004562 nova-compute[99148]: Jul 05 03:30:16.295549 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:16.295549 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:16.295650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:16.295650 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:16.295919 np0000004562 nova-compute[99148]: WARNING os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:30:16.295919 np0000004562 nova-compute[99148]: Jul 05 03:30:16.328333 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.40.100,3260] Jul 05 03:30:16.328333 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.40.100,3260] successful. Jul 05 03:30:16.328333 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.342190 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.353026 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.50.100,3260] Jul 05 03:30:16.353026 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.50.100,3260] successful. Jul 05 03:30:16.353026 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.357117 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.part --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.357499 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] 3a097e0f-2e03-4087-b194-550e03175ca1 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:30:16.358212 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:30:16.358508 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.part /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:16.359654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:16.367550 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:16.384733 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:16.388853 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:16.390101 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:16.391579 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:16.393850 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.393850 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.393850 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:16.394071 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.394071 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:16.394071 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:16.394875 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:16.395041 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:16.395516 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:16.396168 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:16.397959 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:16.398085 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:16.417513 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:16.417513 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:16.419622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:16.419622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:16.466179 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updating instance_info_cache with network_info: [{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:16.508846 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feb2d4d36c2742ffb406ab17c8ced7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3821d2d075c94e5499a469f3ef5e7c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:16.537927 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.part /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.converted" returned: 0 in 0.179s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.548609 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.625381 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f.converted --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.626451 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.300s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:16.626980 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.633894 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.635435 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.700027 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json" returned: 0 in 0.064s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.700505 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:16.701047 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:16.702751 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.706625 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:16.707083 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.773063 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json" returned: 0 in 0.063s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.773745 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f,backing_fmt=raw /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.807665 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f,backing_fmt=raw /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk 1073741824" returned: 0 in 0.034s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.808400 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:16.808997 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.894144 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:16.901191 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f63a4931a9ccb1d4764ceb22449a0ba7d21baf5f --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.902459 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:16.902722 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:16.969894 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Releasing lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:16.970524 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Instance network_info: |[{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:16.971134 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] Acquired lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:16.972591 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Refreshing network info cache for port 0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:16.987347 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:16.988211 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Cannot resize image /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:16.988982 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:16.990331 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Ensure instance console log exists: /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:16.990974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:16.991316 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:16.991499 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:16.996958 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Start _get_guest_xml network_info=[{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:29:58Z,direct_url=,disk_format='qcow2',id=3a097e0f-2e03-4087-b194-550e03175ca1,min_disk=0,min_ram=0,name='',owner='25d5cd65835143e2b029dc5156573167',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:30:01Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '3a097e0f-2e03-4087-b194-550e03175ca1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:16.999071 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:17.000968 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3a097e0f-2e03-4087-b194-550e03175ca1', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-19656028', uuid='dceabcd9-3341-412c-8492-121a739b626d'), owner=OwnerMeta(userid='0fc9d8d23e4a43009ede6e0b2291c365', username='tempest-AttachSCSIVolumeTestJSON-594600634-project-member', projectid='8f15da77ec4e4a65bcdd563097de4c3b', projectname='tempest-AttachSCSIVolumeTestJSON-594600634'), image=ImageMeta(id='3a097e0f-2e03-4087-b194-550e03175ca1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222217.0002854) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:17.002126 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:17.002562 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:17.004964 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:17.005549 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:17.006563 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:17.007431 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:29:58Z,direct_url=,disk_format='qcow2',id=3a097e0f-2e03-4087-b194-550e03175ca1,min_disk=0,min_ram=0,name='',owner='25d5cd65835143e2b029dc5156573167',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:30:01Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:17.007431 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:17.007635 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:17.007734 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:17.007872 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:17.008009 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:17.008178 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:17.008284 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:17.008413 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:17.008743 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:17.008896 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:17.019758 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Successfully created port: e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:17.026667 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-19656028',display_name='tempest-AttachSCSIVolumeTestJSON-server-19656028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachscsivolumetestjson-server-19656028',id=5,image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+3DS82fY0U/rThb6pQQ6j1XS2utJatvWGcTk1MuWQ5LomKYQk4vSWjdhd172XpTzt742XVHkH8JABmelxFGIMyDIEg4c9dlJKtk+55017FeTkD2o9GuC/UnZ3J7BEGQ==',key_name='tempest-keypair-2137131373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f15da77ec4e4a65bcdd563097de4c3b',ramdisk_id='',reservation_id='r-l2mg5068',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-594600634',owner_user_name='tempest-AttachSCSIVolumeTestJSON-594600634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc9d8d23e4a43009ede6e0b2291c365',uuid=dceabcd9-3341-412c-8492-121a739b626d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:17.027666 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converting VIF {"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:17.027666 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:17.028344 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lazy-loading 'pci_devices' on Instance uuid dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:17.136741 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:17.136877 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:17.136925 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] No VIF found with MAC fa:16:3e:fd:e8:7f, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:17.137463 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Using config drive Jul 05 03:30:17.208392 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:30:17.291949 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:17.292173 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:17.417670 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:17.474459 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:17.493374 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] End _get_guest_xml xml= Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: dceabcd9-3341-412c-8492-121a739b626d Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: instance-00000005 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: tempest-AttachSCSIVolumeTestJSON-server-19656028 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 2026-07-05 03:30:17 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: True Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: bare Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: scsi Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: scsi Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: virtio-scsi Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: tempest-AttachSCSIVolumeTestJSON-594600634-project-member Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: tempest-AttachSCSIVolumeTestJSON-594600634 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: dceabcd9-3341-412c-8492-121a739b626d Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: dceabcd9-3341-412c-8492-121a739b626d Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]:
Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]:
Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: Jul 05 03:30:17.534866 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:17.536887 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Preparing to wait for external event network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:17.536887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:17.536887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:17.536887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:17.536887 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-19656028',display_name='tempest-AttachSCSIVolumeTestJSON-server-19656028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachscsivolumetestjson-server-19656028',id=5,image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+3DS82fY0U/rThb6pQQ6j1XS2utJatvWGcTk1MuWQ5LomKYQk4vSWjdhd172XpTzt742XVHkH8JABmelxFGIMyDIEg4c9dlJKtk+55017FeTkD2o9GuC/UnZ3J7BEGQ==',key_name='tempest-keypair-2137131373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f15da77ec4e4a65bcdd563097de4c3b',ramdisk_id='',reservation_id='r-l2mg5068',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-594600634',owner_user_name='tempest-AttachSCSIVolumeTestJSON-594600634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc9d8d23e4a43009ede6e0b2291c365',uuid=dceabcd9-3341-412c-8492-121a739b626d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:17.537119 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converting VIF {"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:17.537119 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:17.537119 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:17.538321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.538321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:17.538321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:17.539874 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.539874 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37d7fbb0-1f83-5b5b-89d5-d971fc77de00', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:17.541068 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.541068 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:17.541820 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.544504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.544504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0783e26a-b8, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:17.544504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0783e26a-b8, col_values=(('qos', UUID('f1cc0ee3-4d5c-496b-951d-826c4d61321d')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:17.544504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0783e26a-b8, col_values=(('external_ids', {'iface-id': '0783e26a-b86f-4c47-9d34-e5257070756f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:de:b4', 'vm-uuid': 'dceabcd9-3341-412c-8492-121a739b626d'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:17.545756 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.546535 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:17.550949 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.562443 np0000004562 nova-compute[99148]: INFO os_vif [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') Jul 05 03:30:17.563738 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.586613 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.645964 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:17.742462 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:17.742918 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:17.743044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:17.743132 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:17.743233 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Processing event network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:17.743315 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:17.743416 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:17.743516 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:17.743601 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:17.743691 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] No waiting events found dispatching network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:17.743808 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-ad3c07a2-45a8-4e9b-9f21-e4cee28fc806 req-620e63c6-9d21-451f-9262-6a9423012255 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received unexpected event network-vif-plugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb for instance with vm_state building and task_state spawning. Jul 05 03:30:17.794819 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:17.809059 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Successfully updated port: e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:17.879834 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Creating config drive at /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.config Jul 05 03:30:17.888916 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy7lo_2vn {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:17.905242 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-changed-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:17.905649 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Refreshing instance network info cache due to event network-changed-e965727e-40f0-49fd-9c81-02b644cb02a5. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:17.905649 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] Acquiring lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:17.905887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] Acquired lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:17.905948 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Refreshing network info cache for port e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:17.930558 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.932227 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy7lo_2vn" returned: 0 in 0.043s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:17.947031 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:17.974813 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:18.162350 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updated VIF entry in instance network info cache for port 0783e26a-b86f-4c47-9d34-e5257070756f. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:18.162622 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updating instance_info_cache with network_info: [{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:18.232366 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Found WWN 330000000ad4d149e for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:30:18.232748 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:18.232927 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000ad4d149e', 'path': '/dev/dm-0', 'multipath_id': '330000000ad4d149e'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:18.233047 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ad4d149e', 'path': '/dev/dm-0', 'multipath_id': '330000000ad4d149e'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:30:18.237831 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lazy-loading 'flavor' on Instance uuid 449dfef2-349e-4d2f-bf24-c52969269a1c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:18.303938 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.439s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:18.304980 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:18.314417 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:18.374007 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:18.380476 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:18.418468 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:18.434537 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:18.435589 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:18.436532 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Creating image(s) Jul 05 03:30:18.436605 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:18.436758 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "/opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:18.437201 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "/opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:18.437703 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:18.440208 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:18.443038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:18.509931 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:18.520620 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:18.521223 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:18.521703 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:18.522262 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:18.526136 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:18.526536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:18.593693 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.067s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:18.594809 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:18.628452 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk 1073741824" returned: 0 in 0.033s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:18.629262 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:18.629666 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:18.665342 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f0a4c1f-cd04-4a68-a2db-06c827c2e8dd req-be8fa465-cfcb-48b4-a9f2-f44f9839424c service nova] Releasing lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:18.700692 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:18.702765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.073s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:18.703417 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:18.703661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:18.747313 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Attempting to attach volume 6da48ae1-2bec-4a9e-a5e2-81d6bd434044 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] attach device xml: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: 6da48ae1-2bec-4a9e-a5e2-81d6bd434044 Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: Jul 05 03:30:18.748730 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:30:18.793206 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:18.793580 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Cannot resize image /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:18.794123 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:18.794123 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Ensure instance console log exists: /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:18.794497 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:18.794646 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:18.794743 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:18.814503 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:18.814503 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:18.814503 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:18.814503 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:18.905981 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feb2d4d36c2742ffb406ab17c8ced7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3821d2d075c94e5499a469f3ef5e7c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:19.085659 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No BDM found with device name sda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:19.086346 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No BDM found with device name sdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:19.086346 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No VIF found with MAC fa:16:3e:0f:de:b4, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:19.086990 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Using config drive Jul 05 03:30:19.188784 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:19.189358 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:19.189536 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] VM Started (Lifecycle Event) Jul 05 03:30:19.195792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:19.197531 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance spawned successfully. Jul 05 03:30:19.198005 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:19.203534 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-35a8d81e-83fb-40fe-a094-20640f98f908 req-740b7572-a20f-4a57-a35f-91691b21891a service nova] Releasing lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:19.205225 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquired lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:19.205225 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:19.318462 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:19.367119 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Successfully created port: 066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:19.540685 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:19.595087 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:19.691915 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:19.693258 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:19.706204 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.706329 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.706793 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.706920 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.707199 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.707442 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:19.784973 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:19.797886 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Creating config drive at /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.config Jul 05 03:30:19.802701 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpantkkpzz {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:19.828643 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:19.837590 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpantkkpzz" returned: 0 in 0.035s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:19.854499 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:19.859042 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:19.859353 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:19.859811 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:19.860016 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Processing event network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:19.860170 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:19.860444 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:19.860567 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:19.860668 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:19.860793 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] No waiting events found dispatching network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:19.860941 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-229e9222-5fe3-4a1a-9358-ffefa7be1bbb req-7761d1f1-4191-4191-ab71-418e68c9c5e6 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received unexpected event network-vif-plugged-0783e26a-b86f-4c47-9d34-e5257070756f for instance with vm_state building and task_state spawning. Jul 05 03:30:20.013357 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:20.115121 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Successfully updated port: 066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:20.178422 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:20.178729 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing instance network info cache due to event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:20.178808 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] Acquiring lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:20.179226 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] Acquired lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:20.179226 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing network info cache for port 066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:20.198130 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:20.198567 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:20.198702 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] VM Paused (Lifecycle Event) Jul 05 03:30:20.218510 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Took 7.30 seconds to spawn the instance on the hypervisor. Jul 05 03:30:20.218510 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:20.228556 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:20.228923 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:20.229072 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:20.229243 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:20.229409 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No event matching network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 in dict_keys([('network-vif-plugged', '8c91f432-9afa-42c0-95c5-81ebf116e5e9')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:20.229596 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-bc522d19-a355-47f5-920f-56b06f11c500 req-14376ca8-4f9c-4ceb-93bd-34f212caf123 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state building and task_state spawning. Jul 05 03:30:20.235873 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updating instance_info_cache with network_info: [{"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:20.311432 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:20.318873 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:20.417392 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:20.417542 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:20.417609 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:20.417701 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] No VIF found with MAC fa:16:3e:28:ac:1c, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:20.619903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:20.681378 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:20.704801 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:20.711013 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:20.711113 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] VM Resumed (Lifecycle Event) Jul 05 03:30:20.731937 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Took 12.80 seconds to build instance. Jul 05 03:30:20.739616 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Releasing lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:20.740138 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance network_info: |[{"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:20.743348 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Start _get_guest_xml network_info=[{"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:20.747492 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:20.748738 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1704194434-1', uuid='a5af3d1a-6bd5-427a-90fd-2a464878e157'), owner=OwnerMeta(userid='feb2d4d36c2742ffb406ab17c8ced7e1', username='tempest-TestMultiAttachVolumeSwap-530722390-project-member', projectid='3821d2d075c94e5499a469f3ef5e7c47', projectname='tempest-TestMultiAttachVolumeSwap-530722390'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222220.748354) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:20.750257 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:20.751211 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:20.753413 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:20.754066 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:20.754485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:20.754849 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:20.755009 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:20.755132 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:20.755263 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:20.755374 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:20.755477 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:20.755650 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:20.755806 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:20.755957 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:20.756107 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:20.756284 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:20.771694 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-1',id=6,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=a5af3d1a-6bd5-427a-90fd-2a464878e157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:20.772063 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:20.772912 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:20.773573 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'pci_devices' on Instance uuid a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:20.793609 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:20.842967 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:20.842967 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:20.842967 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Creating image(s) Jul 05 03:30:20.844038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "/opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:20.844038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "/opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:20.845964 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "/opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:20.847652 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:20.852548 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:20.854090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:20.952794 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:20.953231 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:20.953984 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:20.955199 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:20.961096 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:20.961437 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:21.044249 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:21.048084 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:21.048563 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:21.082672 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk 1073741824" returned: 0 in 0.034s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:21.083174 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.129s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:21.083562 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:21.152557 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:21.155761 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:21.158179 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] Instance spawned successfully. Jul 05 03:30:21.158900 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:21.162910 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:21.164210 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:21.164939 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:21.165503 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:21.170763 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:21.171154 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:21.172413 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:21.214129 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:21.223679 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:21.235454 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.307s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:21.249523 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:21.249523 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:21.255205 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.259050 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:21.259506 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Cannot resize image /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:21.259908 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:21.260316 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Ensure instance console log exists: /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:21.260421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:21.260824 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:21.260824 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] End _get_guest_xml xml= Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: a5af3d1a-6bd5-427a-90fd-2a464878e157 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: instance-00000006 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-server-1704194434-1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 2026-07-05 03:30:20 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: True Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: bare Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-530722390-project-member Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-530722390 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: a5af3d1a-6bd5-427a-90fd-2a464878e157 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: a5af3d1a-6bd5-427a-90fd-2a464878e157 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: Jul 05 03:30:21.277449 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:21.279973 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Preparing to wait for external event network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:21.279973 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:21.279973 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:21.279973 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:21.279973 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-1',id=6,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=a5af3d1a-6bd5-427a-90fd-2a464878e157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:21.281779 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:21.282777 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.286360 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4327134-d74b-51ae-967a-3f4f6ccd6118', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:21.287409 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.288159 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:21.289585 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.291964 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.292117 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape965727e-40, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:21.292422 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape965727e-40, col_values=(('qos', UUID('e75eb3c3-9e32-43db-9f6b-e49195a92c28')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:21.292602 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape965727e-40, col_values=(('external_ids', {'iface-id': 'e965727e-40f0-49fd-9c81-02b644cb02a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:70:b2', 'vm-uuid': 'a5af3d1a-6bd5-427a-90fd-2a464878e157'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:21.293819 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.295388 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:21.300282 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.306151 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.310950 np0000004562 nova-compute[99148]: INFO os_vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') Jul 05 03:30:21.334668 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.546680 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5b571f94-b1f4-4bf6-a986-bf69f7344d4c req-1b7c82df-3422-4820-9036-3a1924a46067 service nova] Releasing lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:21.547359 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquired lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:21.547632 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:21.656239 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.676598 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Took 6.36 seconds to spawn the instance on the hypervisor. Jul 05 03:30:21.677797 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:21.678187 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.683532 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:21.729259 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:21.729749 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] VM Started (Lifecycle Event) Jul 05 03:30:21.752005 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:21.891079 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-aa539687-c273-4a11-b0da-c02b40e59113 req-34ae3ea5-4f1e-453c-985b-b2ce1aaae9a4 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:21.891297 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-aa539687-c273-4a11-b0da-c02b40e59113 req-34ae3ea5-4f1e-453c-985b-b2ce1aaae9a4 service nova] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:21.895704 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-aa539687-c273-4a11-b0da-c02b40e59113 req-34ae3ea5-4f1e-453c-985b-b2ce1aaae9a4 service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:21.895704 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-aa539687-c273-4a11-b0da-c02b40e59113 req-34ae3ea5-4f1e-453c-985b-b2ce1aaae9a4 service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:21.895704 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-aa539687-c273-4a11-b0da-c02b40e59113 req-34ae3ea5-4f1e-453c-985b-b2ce1aaae9a4 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Processing event network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:21.998271 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-72700a62-fb01-49c0-ad75-8b1beac8b34e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.522s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:22.170007 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:22.190301 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Took 14.10 seconds to build instance. Jul 05 03:30:22.235774 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:22.237420 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:22.313762 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:22.313972 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:22.314144 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:22.316645 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:22.317062 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Processing event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:22.317333 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:22.317517 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:22.317737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:22.318122 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:22.318122 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:22.318305 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-b60ac54c-bd6b-443a-9a22-a61aaeccc4bc req-7855f787-fa0a-4360-821f-df4ffd647cbc service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state building and task_state spawning. Jul 05 03:30:22.320990 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:22.326903 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:22.334309 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance spawned successfully. Jul 05 03:30:22.334701 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:22.344233 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:22.344421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:22.347174 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:22.347346 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Claim successful on node np0000004562 Jul 05 03:30:22.454259 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:22.508695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:22.508695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:22.508695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:22.508695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:22.509621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:22.511264 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Terminating instance Jul 05 03:30:22.630248 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating instance_info_cache with network_info: [{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:22.692350 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.610s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:22.739459 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:22.739597 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] VM Paused (Lifecycle Event) Jul 05 03:30:22.835131 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:22.835246 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:22.835334 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No VIF found with MAC fa:16:3e:2f:70:b2, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:22.835674 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Using config drive Jul 05 03:30:22.854634 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:22.854634 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:22.854967 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:22.857245 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:22.857245 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:22.857245 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:23.015549 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:30:23.023932 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.031776 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.123857 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:23.124401 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:23.124555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:23.124669 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:23.124828 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] No event matching network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 in dict_keys([('network-vif-plugged', 'a925ff58-8914-48a7-8301-62b925285161')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:23.124972 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-975ddf0c-9c2b-4bc9-98b5-14a21b91da26 req-d66a3046-648b-4051-9214-cce007ca7e94 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received unexpected event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 for instance with vm_state building and task_state spawning. Jul 05 03:30:23.133289 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Releasing lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:23.133549 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance network_info: |[{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:23.136495 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Start _get_guest_xml network_info=[{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:23.143858 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:23.144263 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:23.145132 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:23.146113 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1704194434-2', uuid='8925c8cc-b844-4697-9d32-99d9b39c394f'), owner=OwnerMeta(userid='feb2d4d36c2742ffb406ab17c8ced7e1', username='tempest-TestMultiAttachVolumeSwap-530722390-project-member', projectid='3821d2d075c94e5499a469f3ef5e7c47', projectname='tempest-TestMultiAttachVolumeSwap-530722390'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222223.1449027) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:23.147686 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:23.148063 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:23.151822 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:23.151987 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:23.154654 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:23.154981 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:23.155111 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:23.155249 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:23.155392 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:23.155509 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:23.155578 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:23.155723 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:23.155854 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:23.155957 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:23.156056 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:23.156175 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:23.175003 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-2',id=7,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=8925c8cc-b844-4697-9d32-99d9b39c394f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:23.175569 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:23.175806 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:23.176254 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'pci_devices' on Instance uuid 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:23.245356 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:23.246319 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:23.246453 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] VM Resumed (Lifecycle Event) Jul 05 03:30:23.326358 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Instance destroyed successfully. Jul 05 03:30:23.326358 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lazy-loading 'resources' on Instance uuid 449dfef2-349e-4d2f-bf24-c52969269a1c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:23.344307 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:23.363588 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Took 20.47 seconds to spawn the instance on the hypervisor. Jul 05 03:30:23.363778 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:23.612342 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Creating config drive at /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.config Jul 05 03:30:23.619344 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpew1btgfb {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:23.647934 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:23.658218 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpew1btgfb" returned: 0 in 0.039s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] End _get_guest_xml xml= Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 8925c8cc-b844-4697-9d32-99d9b39c394f Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: instance-00000007 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-server-1704194434-2 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 2026-07-05 03:30:23 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: True Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: bare Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-530722390-project-member Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: tempest-TestMultiAttachVolumeSwap-530722390 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 8925c8cc-b844-4697-9d32-99d9b39c394f Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 8925c8cc-b844-4697-9d32-99d9b39c394f Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: Jul 05 03:30:23.682989 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:23.686205 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Preparing to wait for external event network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:23.686205 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:23.686205 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:23.686205 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:23.686205 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-2',id=7,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=8925c8cc-b844-4697-9d32-99d9b39c394f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:23.686841 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:23.686841 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:23.686841 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:23.687930 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.688299 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.688585 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:23.692871 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.693128 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f491682b-201d-5b4e-9282-2ceee3a7bcc4', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.695884 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.697024 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:23.701161 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.701960 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap066bb55b-ad, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.701960 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap066bb55b-ad, col_values=(('qos', UUID('d0c60c3b-c5d7-44dd-b1f4-a14f4ca04026')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.702221 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap066bb55b-ad, col_values=(('external_ids', {'iface-id': '066bb55b-ad03-4207-b570-25e22bfbb480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a5:59', 'vm-uuid': '8925c8cc-b844-4697-9d32-99d9b39c394f'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.706376 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:23.710799 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.721543 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.724632 np0000004562 nova-compute[99148]: INFO os_vif [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') Jul 05 03:30:23.749188 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:23.751888 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.759973 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: dceabcd9-3341-412c-8492-121a739b626d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:23.830707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1867295979',display_name='tempest-DeleteServersTestJSON-server-1867295979',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-deleteserverstestjson-server-1867295979',id=1,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:30:08Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3a83ec28ff634978a83705e49f447e85',ramdisk_id='',reservation_id='r-92886ed0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-714661285',owner_user_name='tempest-DeleteServersTestJSON-714661285-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:08Z,user_data=None,user_id='44a79361579241c6b5c3dabae6e495d7',uuid=449dfef2-349e-4d2f-bf24-c52969269a1c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:30:23.830940 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converting VIF {"id": "7f677ae1-c458-46bf-bafc-95d08663076e", "address": "fa:16:3e:28:ac:1c", "network": {"id": "bc7343e5-44b9-4ad6-bc0d-ee27930c61ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1327284015-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3a83ec28ff634978a83705e49f447e85", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f677ae1-c4", "ovs_interfaceid": "7f677ae1-c458-46bf-bafc-95d08663076e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:23.831556 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:23.831837 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:30:23.853826 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.867339 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.874496 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.874779 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f677ae1-c4, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.881876 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:23.882568 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Took 27.56 seconds to build instance. Jul 05 03:30:23.883689 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.883875 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6da5a87b-fa95-4396-840a-b08b0da490a4) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:23.886184 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:23.888842 np0000004562 nova-compute[99148]: INFO os_vif [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=7f677ae1-c458-46bf-bafc-95d08663076e,network=Network(bc7343e5-44b9-4ad6-bc0d-ee27930c61ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f677ae1-c4') Jul 05 03:30:23.889982 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:30:23.890408 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:23.890595 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:23.891201 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:23.891607 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:30:23.891780 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:30:23.911341 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.919634 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:23.919634 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:23.919634 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044 (non-flash) Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', '4')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', '3')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044', '4')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Resulting device map defaultdict(. at 0x7249ac7579c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:30:23.922334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Flush multipath device 330000000ad4d149e {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:30:23.931878 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.951094 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:23.968874 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] No waiting events found dispatching network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received unexpected event network-vif-plugged-e965727e-40f0-49fd-9c81-02b644cb02a5 for instance with vm_state building and task_state spawning. Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-changed-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Refreshing instance network info cache due to event network-changed-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquiring lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquired lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:23.988332 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Refreshing network info cache for port 916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:24.027105 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:30:24.060252 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:24.060491 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:24.091040 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:30:24.091229 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:30:24.092258 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:30:24.106452 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:30:24.106681 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:30:24.120070 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.148032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.40.100,3260] Jul 05 03:30:24.148032 np0000004562 nova-compute[99148]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.40.100,3260] successful. Jul 05 03:30:24.148032 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.160050 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.171335 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "4d856996-148c-4732-9428-4f5611315969" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:24.171555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:24.172680 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.177220 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:24.204995 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.50.100,3260] Jul 05 03:30:24.204995 np0000004562 nova-compute[99148]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-6da48ae1-2bec-4a9e-a5e2-81d6bd434044, portal: 192.168.50.100,3260] successful. Jul 05 03:30:24.204995 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] <== disconnect_volume: return (326ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Deleting instance files /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c_del Jul 05 03:30:24.219692 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Deletion of /opt/stack/data/nova/instances/449dfef2-349e-4d2f-bf24-c52969269a1c_del complete Jul 05 03:30:24.265776 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:24.265776 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Resumed (Lifecycle Event) Jul 05 03:30:24.385473 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2ecac1cb-5716-4108-a87f-e132e8cbb6b5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.066s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:24.494172 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:24.564640 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:24.674343 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:24.730406 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Took 1.71 seconds to destroy the instance on the hypervisor. Jul 05 03:30:24.731059 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:30:24.731636 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:30:24.731851 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:30:24.732117 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:24.770137 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:24.781851 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:24.913048 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:24.918847 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:25.029093 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:25.034634 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:25.036221 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance spawned successfully. Jul 05 03:30:25.036793 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:25.066597 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updated VIF entry in instance network info cache for port 916d9fcb-aaf2-43c0-afeb-c4d5111c84eb. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:25.066837 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updating instance_info_cache with network_info: [{"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:25.075851 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.731s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:25.077230 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.864s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:25.077230 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:25.082005 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:25.082143 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Claim successful on node np0000004562 Jul 05 03:30:25.223538 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:25.223981 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:25.224072 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:25.224202 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:25.224362 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Processing event network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:25.224544 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:25.224757 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:25.224757 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:25.224980 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:25.225073 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] No waiting events found dispatching network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:25.225215 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-a984b67f-6606-424c-a099-a16ca2936e44 req-0ba79fc8-ce34-404f-99aa-12d87a3c524d service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received unexpected event network-vif-plugged-a925ff58-8914-48a7-8301-62b925285161 for instance with vm_state building and task_state spawning. Jul 05 03:30:25.225985 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Instance event wait completed in 16 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:25.228528 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:25.231657 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Instance spawned successfully. Jul 05 03:30:25.231993 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:25.248908 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:25.258394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:25.258563 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:25.258623 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No VIF found with MAC fa:16:3e:1e:a5:59, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:25.259101 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Using config drive Jul 05 03:30:25.291083 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999365932000046 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:25.291083 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99893398900008 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:25.291083 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998717536999948 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:25.291083 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:25.291083 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] VM Started (Lifecycle Event) Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.543485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.568478 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Releasing lock "refresh_cache-d5282468-599f-4af3-b640-af72408dd7d6" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:25.568606 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-changed-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:25.568750 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Refreshing instance network info cache due to event network-changed-0783e26a-b86f-4c47-9d34-e5257070756f. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:25.568937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquiring lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:25.569041 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquired lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:25.569205 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Refreshing network info cache for port 0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:25.592520 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:25.592661 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:25.592851 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:25.593390 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:25.738541 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.738541 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.738849 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.739067 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.739311 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.739534 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:25.765313 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:25.792158 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:25.794609 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:25.831391 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6eeca41172e40e8a372cac82d88969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6d7dab7b84017ad157933bc5f70e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:25.912915 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:25.953737 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Creating config drive at /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.config Jul 05 03:30:25.956247 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg4k_vcjq {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:26.001923 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg4k_vcjq" returned: 0 in 0.045s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:26.050240 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Took 7.62 seconds to spawn the instance on the hypervisor. Jul 05 03:30:26.050622 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:26.064519 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:26.064519 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:26.064792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:26.065329 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:26.065464 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Processing event network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:26.065628 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:26.065809 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:26.065966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:26.066093 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:26.066272 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] No waiting events found dispatching network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:26.066430 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:30:26.066573 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:26.066742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Acquiring lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:26.066891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:26.067528 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:26.067528 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] No waiting events found dispatching network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:26.067528 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-unplugged-7f677ae1-c458-46bf-bafc-95d08663076e for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:30:26.067666 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-changed-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:26.067824 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Refreshing instance network info cache due to event network-changed-8c91f432-9afa-42c0-95c5-81ebf116e5e9. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:26.067984 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:26.068101 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:26.068284 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Refreshing network info cache for port 8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:26.073544 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:26.096350 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:26.243953 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Took 25.64 seconds to spawn the instance on the hypervisor. Jul 05 03:30:26.244493 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:26.258149 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:26.297671 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:26.298022 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:26.298022 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] VM Paused (Lifecycle Event) Jul 05 03:30:26.361588 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully created port: 7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:26.417782 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Took 1.69 seconds to deallocate network for instance. Jul 05 03:30:26.471773 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:26.481502 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:26.542156 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:26.566814 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Took 13.30 seconds to build instance. Jul 05 03:30:26.570989 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:26.743382 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updated VIF entry in instance network info cache for port 0783e26a-b86f-4c47-9d34-e5257070756f. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:26.744501 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updating instance_info_cache with network_info: [{"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:26.761389 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Took 31.13 seconds to build instance. Jul 05 03:30:26.794893 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:26.795144 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:26.809787 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:26.811519 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:26.811674 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] VM Resumed (Lifecycle Event) Jul 05 03:30:26.854379 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully created port: 924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:27.024199 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Took 0.61 seconds to detach 1 volumes for instance. Jul 05 03:30:27.068437 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:27.070536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.812s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:27.245556 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Releasing lock "refresh_cache-dceabcd9-3341-412c-8492-121a739b626d" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:27.245924 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:27.246080 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:27.246325 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:27.246400 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:27.246552 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] No waiting events found dispatching network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:27.246686 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-0d7f38f6-0759-4d45-a5ee-eea8b37ac9ae req-fe1ec33e-a98c-4dd7-9929-0cefff95b78b service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received unexpected event network-vif-plugged-066bb55b-ad03-4207-b570-25e22bfbb480 for instance with vm_state building and task_state spawning. Jul 05 03:30:27.251493 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updated VIF entry in instance network info cache for port 8c91f432-9afa-42c0-95c5-81ebf116e5e9. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:27.252012 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:27.269182 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9f987eeb-3aa9-4692-bcc5-79ad93ca6c04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 32.648s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:27.298104 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:27.307750 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e28cefa8-a1fc-4963-bc25-43a25a73cd6b req-1d3efe68-8e89-46e2-839f-a4876248f3dc service nova] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Received event network-vif-deleted-7f677ae1-c458-46bf-bafc-95d08663076e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:27.314261 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:27.316530 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:27.373494 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully created port: 86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:27.500157 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:27.506144 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:27.507680 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance spawned successfully. Jul 05 03:30:27.508025 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:27.529894 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:27.613529 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:27.757878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-56330a4e-8011-41f7-82f9-4701833e3963 req-1a8825f9-1b29-4c46-8438-3b634388489c service nova] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:27.800489 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully created port: 746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:27.807633 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.731s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:27.808696 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.559s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:27.809591 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:27.814800 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:27.815224 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Claim successful on node np0000004562 Jul 05 03:30:27.820853 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:27.821061 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] VM Resumed (Lifecycle Event) Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.015707 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:28.120440 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Booting with volume d0e67fcf-50f9-4356-986d-13c7a918e260 at /dev/vda Jul 05 03:30:28.205687 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:28.220209 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:30:28.247918 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:28.265499 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully created port: 21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:28.270451 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:30:28.271565 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:30:28.284228 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:30:28.286243 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559'] Jul 05 03:30:28.286554 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:30:28.286748 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:30:28.287019 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:28.287302 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating existing volume attachment record: f9c6e6e8-1614-4fcd-a147-5ee5ecfa58e4 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:30:28.325572 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:28.330615 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:28.332533 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:28.332533 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:28.332533 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:28.337038 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:28.421542 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76127ae0b2ae45ff8d4cd7430fc67ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31f3215e6204f19859b8f62235b8cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:28.522063 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Took 7.68 seconds to spawn the instance on the hypervisor. Jul 05 03:30:28.522244 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:28.840609 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:28.845938 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] During sync_power_state the instance has a pending task (image_snapshot_pending). Skip. Jul 05 03:30:28.846605 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:28.847434 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] VM Started (Lifecycle Event) Jul 05 03:30:28.885368 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:28.912352 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:28.973773 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:28.974263 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:28.975317 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:28.975406 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:28.975970 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:29.002962 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Successfully created port: 599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:29.034227 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Took 15.73 seconds to build instance. Jul 05 03:30:29.149744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:29.351292 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:29.354753 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:29.360618 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:29.482202 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:29.536749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-057a297e-2a23-4085-ae09-a751e26b9ec1 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.243s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:29.590355 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:29.660043 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] instance snapshotting Jul 05 03:30:29.673352 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:29.673352 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:29.680215 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Successfully updated port: 599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:29.775367 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-changed-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:29.775874 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Refreshing instance network info cache due to event network-changed-599d3a0a-adce-4481-91ed-7f7c3ddfdb00. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:29.775954 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] Acquiring lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:29.776010 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] Acquired lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:29.778928 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Refreshing network info cache for port 599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:29.812400 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Beginning live snapshot process Jul 05 03:30:29.844353 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:29.865921 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:29.866039 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] VM Paused (Lifecycle Event) Jul 05 03:30:29.946485 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Booting with volume a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae at /dev/vdb Jul 05 03:30:29.992320 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:30.002833 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:30:30.022807 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.047445 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:30:30.048241 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:30:30.063325 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:30:30.064967 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559'] Jul 05 03:30:30.065140 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:30:30.065280 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:30:30.065571 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:30.066167 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating existing volume attachment record: 19c0ed05-4145-4496-b940-1dc2f93e148d {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:30:30.111091 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:30.175657 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:30.183300 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:30.187137 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:30.187998 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-bb2e32c9-4929-4707-8b62-218476108cc2. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:30.189058 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:30.278848 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:30.346356 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a0d8e00-97ef-46c3-9f7f-ff63e2987fde req-e13c7a44-76bd-408c-97bd-d2b47715f2d7 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:30.346749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:30.346883 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:30.363602 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:30.366215 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:30.369162 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:30.371629 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:30.372015 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Creating image(s) Jul 05 03:30:30.373378 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:30.373776 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:30.373961 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] VM Resumed (Lifecycle Event) Jul 05 03:30:30.375512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:30.376511 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:30.377210 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:30.382016 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:30.383188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.464536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.081s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:30.464769 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:30.465341 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:30.466257 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:30.470597 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:30.471030 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.548091 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:30.548559 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.572160 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:30.584741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk 1073741824" returned: 0 in 0.034s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:30.584741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.118s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:30.584741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.662699 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.079s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:30.663198 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:30.663447 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:30.690360 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.882s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:30.691380 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:30.697549 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.165s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:30.751520 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:30.751978 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Cannot resize image /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:30.752365 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:30.752606 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Ensure instance console log exists: /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:30.753048 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:30.753315 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:30.753428 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:30.849318 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:30.877864 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:30.882567 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:30.943665 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:31.067249 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:31.068434 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing instance network info cache due to event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:31.069330 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] Acquiring lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:31.069587 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] Acquired lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:31.069909 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing network info cache for port 066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:31.075545 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e237dae1-56cf-460c-9824-d1488035dc2b req-7bde5925-779f-4727-a507-a024647719ca service nova] Releasing lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:31.076090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:31.076312 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:31.171028 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:31.200533 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:31.200748 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:31.201007 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:31.201288 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:31.262970 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:31.328356 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:31.336256 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:31.338206 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76127ae0b2ae45ff8d4cd7430fc67ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31f3215e6204f19859b8f62235b8cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:31.385668 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:31.386077 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:31.386077 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:31.414461 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json -f qcow2" returned: 0 in 0.078s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:31.415053 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:31.464099 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:31.467601 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:31.507395 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:31.508767 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:31.511922 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:31.512300 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:31.572863 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:31.609507 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.097s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:31.610011 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd.delta 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:31.647182 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd.delta 1073741824" returned: 0 in 0.037s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:31.648847 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Quiescing instance not available: QEMU guest agent is not enabled. Jul 05 03:30:31.674061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-195a2f51-ede1-4e7e-92be-50fb7aafb125 req-010690bc-3cab-4ffa-a65d-99ef9daaa21c service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:31.674504 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:31.674761 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:31.677298 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Booting with volume 5c0b1bcc-d802-42f4-9516-cea433ce2cdf at /dev/vdc Jul 05 03:30:31.681054 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:31.706188 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:31.744902 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:31.758784 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:30:31.779381 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:31.806308 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:30:31.806747 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:30:31.828525 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:30:31.830976 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559'] Jul 05 03:30:31.830976 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:30:31.830976 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:30:31.830976 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:31.831694 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating existing volume attachment record: 409a1889-13d6-4031-a3ea-548029d30f6a {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:30:31.932528 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:31.963517 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Successfully created port: 3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:31.966641 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=99148) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 05 03:30:31.969951 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 05 03:30:31.975933 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:32.022437 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:30:32.022915 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd.delta /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:32.061743 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:32.109888 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd.delta /opt/stack/data/nova/instances/snapshots/tmp8atvq7a1/dc5bcf760dcd46739df9cc1f1d4e83cd" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:32.110598 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Snapshot extracted, beginning image upload Jul 05 03:30:32.116381 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Updating instance_info_cache with network_info: [{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:32.177667 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:32.212415 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:32.231968 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updated VIF entry in instance network info cache for port 066bb55b-ad03-4207-b570-25e22bfbb480. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:32.232851 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating instance_info_cache with network_info: [{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:32.272367 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:32.288026 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:32.288661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:32.289269 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:32.289537 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:32.290077 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:32.290077 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-fdcdc7c5-cfb7-44d9-9c5c-9a1641e8b656 req-127209a2-e400-408e-9e9f-dac16ddef3cc service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 for instance with vm_state building and task_state block_device_mapping. Jul 05 03:30:32.468750 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:32.481849 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:32.492892 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.798s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:32.553635 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Deleted allocations for instance 449dfef2-349e-4d2f-bf24-c52969269a1c Jul 05 03:30:32.620583 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Successfully updated port: 3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:32.622790 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:32.623141 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance network_info: |[{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:32.625036 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start _get_guest_xml network_info=[{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:32.628565 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:32.631514 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-449495268', uuid='79dcf4df-1d4d-462e-9b02-4bf431533787'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222232.6310415) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:32.633634 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:32.636173 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:32.636807 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:32.637310 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:32.638933 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:32.639892 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:32.643671 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:32.661691 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449495268',display_name='tempest-ServerRescueNegativeTestJSON-server-449495268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-449495268',id=9,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-kay3kuuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:29Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=79dcf4df-1d4d-462e-9b02-4bf431533787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:32.662418 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:32.662811 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:32.663541 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:32.735035 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-414fee2a-586a-445a-b727-539e5b263cef req-65fc60ab-c19e-4591-a679-04e01f80ad52 service nova] Releasing lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:32.971245 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-178924d8-1bac-4b51-aff5-ad221b68cc0f req-c157e2d7-0ae3-4138-bb1a-57d6c191dd09 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:33.126502 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:33.126706 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:33.126908 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:33.148631 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-changed-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:33.149326 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Refreshing instance network info cache due to event network-changed-3e11d0a2-91a5-499e-8187-36d21e002ab8. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:33.149891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] Acquiring lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] End _get_guest_xml xml= Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: instance-00000009 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-449495268 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 2026-07-05 03:30:32 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: True Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: bare Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: Jul 05 03:30:33.166905 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:33.170020 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Preparing to wait for external event network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:33.170020 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:33.170020 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:33.170020 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.170020 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449495268',display_name='tempest-ServerRescueNegativeTestJSON-server-449495268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-449495268',id=9,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-kay3kuuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:29Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=79dcf4df-1d4d-462e-9b02-4bf431533787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:33.170460 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:33.170880 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:33.171475 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:33.174070 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.174763 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:33.175169 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:33.176403 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.176647 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '629d055c-47bf-5d9b-87c6-95e3b4870e51', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:33.179070 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.180339 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:33.182739 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.182933 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap599d3a0a-ad, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:33.183402 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap599d3a0a-ad, col_values=(('qos', UUID('f2726a0d-0eec-4e92-8ebc-b6ddfe671331')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:33.183609 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap599d3a0a-ad, col_values=(('external_ids', {'iface-id': '599d3a0a-adce-4481-91ed-7f7c3ddfdb00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:d2:46', 'vm-uuid': '79dcf4df-1d4d-462e-9b02-4bf431533787'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:33.188005 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.189613 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:33.193387 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.203898 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.214252 np0000004562 nova-compute[99148]: INFO os_vif [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') Jul 05 03:30:33.235562 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.241511 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:33.242843 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:33.242843 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Creating image(s) Jul 05 03:30:33.243265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:33.243575 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:33.244345 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.245183 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:33.248281 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:33.249827 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:33.338827 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.088s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:33.340804 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:33.340804 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:33.341653 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:33.347349 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:33.347349 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:33.432962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:33.433431 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:33.469034 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:33.469405 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-924b28f4-27f7-4a6b-aa53-667cdcec6779. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:33.469507 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:33.472422 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:33.472681 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:33.482304 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk 1073741824" returned: 0 in 0.049s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:33.484588 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.144s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.484922 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:33.574741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4359b482-14ce-4e00-9c19-d85ae816712e tempest-DeleteServersTestJSON-714661285 tempest-DeleteServersTestJSON-714661285-project-member] Lock "449dfef2-349e-4d2f-bf24-c52969269a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 11.066s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.576080 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:33.576425 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:33.576665 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:33.635418 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.662471 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:33.673703 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:33.678393 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:33.678837 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Cannot resize image /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:33.679490 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:33.679694 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Ensure instance console log exists: /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:33.680299 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:33.680697 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:33.680974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.744278 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:33.948263 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:33.968005 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:33.969575 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:33.969875 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Creating image(s) Jul 05 03:30:33.972861 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:30:33.973012 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Ensure instance console log exists: /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:33.973358 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:33.973594 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:33.973828 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:33.974658 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:34.074584 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:34.140594 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Updating instance_info_cache with network_info: [{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:34.270498 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:34.644703 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:34.645285 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance network_info: |[{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:34.647079 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start _get_guest_xml network_info=[{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:34.648462 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] Acquired lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:34.648462 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Refreshing network info cache for port 3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:34.650340 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:34.651893 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1704808838', uuid='4d856996-148c-4732-9428-4f5611315969'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222234.6512825) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:34.652761 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:34.653367 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:34.654664 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:34.654928 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:34.655972 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:34.656688 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:34.657285 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:34.657841 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:34.658141 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:34.658745 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:34.658745 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:34.658914 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:34.659218 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:34.659328 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:34.659494 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:34.659947 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:34.673928 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704808838',display_name='tempest-ServerRescueNegativeTestJSON-server-1704808838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-1704808838',id=10,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-m0bw230r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:32Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=4d856996-148c-4732-9428-4f5611315969,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:34.674145 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:34.674817 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:34.675460 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:34.744026 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:34.744026 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:34.744156 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:f9:d2:46, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:34.744508 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Using config drive Jul 05 03:30:34.772892 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:34.774502 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:34.775391 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:34.775745 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:34.776064 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:34.776337 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:34.776753 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-71e78282-408d-4660-915e-6af635d99681 req-e70d0344-bb13-4a38-af8d-3aa8d391ffb7 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Processing event network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:34.827499 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:34.829955 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-746e6639-5d12-4455-a62c-e72b29391501. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:34.830241 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:34.830391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:34.830500 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:35.150367 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] End _get_guest_xml xml= Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: instance-0000000a Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-1704808838 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 2026-07-05 03:30:34 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: True Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: bare Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: Jul 05 03:30:35.178196 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:35.180940 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Preparing to wait for external event network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:35.180940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:35.180940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:35.180940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:35.185791 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704808838',display_name='tempest-ServerRescueNegativeTestJSON-server-1704808838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-1704808838',id=10,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-m0bw230r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:32Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=4d856996-148c-4732-9428-4f5611315969,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:35.185791 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:35.185791 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:35.186085 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:35.186085 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.186085 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:35.186085 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:35.186268 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.186402 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95db7b85-5f17-5f6f-b867-541af1d8bd73', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:35.200366 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.201449 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:35.202356 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.204905 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.204905 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e11d0a2-91, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:35.205225 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e11d0a2-91, col_values=(('qos', UUID('25742128-8fe8-419e-a419-87faa61d9be1')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:35.205333 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e11d0a2-91, col_values=(('external_ids', {'iface-id': '3e11d0a2-91a5-499e-8187-36d21e002ab8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:c8:e6', 'vm-uuid': '4d856996-148c-4732-9428-4f5611315969'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:35.206896 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.209229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:35.214684 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.225036 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.227145 np0000004562 nova-compute[99148]: INFO os_vif [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') Jul 05 03:30:35.247416 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:35.247416 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-86bf53df-be71-4602-af51-8fdc20c2874d. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:35.247416 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:35.259166 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.267975 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:35.333942 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:35.443432 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:35.454062 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:35.471709 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Creating config drive at /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config Jul 05 03:30:35.475578 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw9lu621f {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:35.509214 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw9lu621f" returned: 0 in 0.034s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] No waiting events found dispatching network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:35.574829 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-39470f64-7db9-4006-8a1a-ebe61ddbc627 req-8556ef5e-4ade-483a-8c84-e8d3e3ca04d8 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received unexpected event network-vif-plugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 for instance with vm_state building and task_state spawning. Jul 05 03:30:35.651229 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Snapshot image upload complete Jul 05 03:30:35.652145 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d86be127-7364-499c-813f-5d30d65bf8b4 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Took 5.99 seconds to snapshot the instance on the hypervisor. Jul 05 03:30:35.704331 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:35.716163 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:35.868011 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Updated VIF entry in instance network info cache for port 3e11d0a2-91a5-499e-8187-36d21e002ab8. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:35.868441 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Updating instance_info_cache with network_info: [{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:35.948380 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Successfully updated port: 21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:36.000538 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:36.008687 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:36.213349 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4a962e18-50c3-485c-9af6-118dbb953a16 req-3c82e7ce-fc58-40b6-b8b8-a45591f60ff2 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:36.213882 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:36.214081 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:36.263743 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:36.371912 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b0fb0103-fdbc-41ce-b37d-290370b07821 req-be692c74-7fce-4bbe-b514-afafd239d12d service nova] Releasing lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:36.451768 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:36.717933 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:36.771618 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:36.771859 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:36.772022 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:0a:c8:e6, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:36.772817 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Using config drive Jul 05 03:30:36.835316 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:36.870321 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:36.870572 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Started (Lifecycle Event) Jul 05 03:30:36.873433 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:36.880161 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:36.886807 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance spawned successfully. Jul 05 03:30:36.887192 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:36.928354 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:36.928503 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:36.928947 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:37.033621 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:37.051344 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:37.283064 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:37.353898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:37.355695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:37.355695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:37.355695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:37.355858 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Processing event network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:37.355858 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:37.355981 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:37.356144 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:37.356288 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:37.356426 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] No waiting events found dispatching network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:37.356526 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-6ea45b08-7f7c-409f-a1b6-f19a0e18402f req-5112ffb6-9798-442c-9980-d2dc4e72f4c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received unexpected event network-vif-plugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 for instance with vm_state building and task_state spawning. Jul 05 03:30:37.379008 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:37.389271 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:37.405064 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.405064 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.405617 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.405617 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.405827 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.406259 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:37.485613 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Creating config drive at /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config Jul 05 03:30:37.495966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqs6x55wm {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:37.532917 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqs6x55wm" returned: 0 in 0.040s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:37.536374 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ee0896f1-ac16-4cb8-b1c8-60bcef04014a req-e9ce2f4e-c5df-407f-9272-bd7ac662a371 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:37.537465 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:37.538366 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:37.549126 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:37.892519 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:37.893064 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:37.893064 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Paused (Lifecycle Event) Jul 05 03:30:37.917349 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Took 7.55 seconds to spawn the instance on the hypervisor. Jul 05 03:30:37.917349 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:38.085082 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:38.089995 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:38.134822 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:38.311730 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:38.360049 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:38.360682 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:38.399201 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:38.402368 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:38.402504 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Resumed (Lifecycle Event) Jul 05 03:30:38.436924 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Took 14.28 seconds to build instance. Jul 05 03:30:38.715863 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:38.867954 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:38.909593 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:38.914490 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:38.944433 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7b31d068-f5c6-400a-9b0e-d84ceac2af54 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.800s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:39.058541 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:39.063795 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:39.066616 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance spawned successfully. Jul 05 03:30:39.067467 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:39.095746 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:39.417313 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:39.417313 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Started (Lifecycle Event) Jul 05 03:30:39.439226 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:39.439226 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:39.442924 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:39.444318 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Claim successful on node np0000004562 Jul 05 03:30:39.525675 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:39.576337 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.576337 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.576677 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.576980 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.577292 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.577584 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:39.894560 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:39.919775 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:39.921026 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:40.082981 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Took 6.84 seconds to spawn the instance on the hypervisor. Jul 05 03:30:40.083145 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:40.223676 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:40.250785 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:40.286859 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005135750000135886 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:40.289329 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:40.292945 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:40.293221 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] VM Stopped (Lifecycle Event) Jul 05 03:30:40.425514 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:40.425514 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:40.425514 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Paused (Lifecycle Event) Jul 05 03:30:40.594145 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Took 15.42 seconds to build instance. Jul 05 03:30:40.707740 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:40.799707 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2887b654-bd5f-49f8-88cd-e0bed6fbfacc None None] [instance: 449dfef2-349e-4d2f-bf24-c52969269a1c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:40.913350 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:40.933053 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:40.937443 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:40.937614 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Resumed (Lifecycle Event) Jul 05 03:30:41.026951 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Rescuing Jul 05 03:30:41.027570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:41.027729 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:41.027899 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:41.047196 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:41.047387 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:41.097090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e4fa171-61ad-4765-ae02-40f155be40c4 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.925s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:41.265410 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:41.415948 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:41.416646 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance network_info: |[{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:41.417648 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Start _get_guest_xml network_info=[{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f9c6e6e8-1614-4fcd-a147-5ee5ecfa58e4', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7f4104ac-fa7c-495a-9f64-c9b835bc6073', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'serial': 'd0e67fcf-50f9-4356-986d-13c7a918e260'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '19c0ed05-4145-4496-b940-1dc2f93e148d', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7f4104ac-fa7c-495a-9f64-c9b835bc6073', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'serial': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '409a1889-13d6-4031-a3ea-548029d30f6a', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7f4104ac-fa7c-495a-9f64-c9b835bc6073', 'attached_at': '', 'detached_at': '', 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'serial': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:41.418229 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:41.418336 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:41.421072 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:41.422672 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1167103678', uuid='7f4104ac-fa7c-495a-9f64-c9b835bc6073'), owner=OwnerMeta(userid='d6eeca41172e40e8a372cac82d88969c', username='tempest-TaggedBootDevicesTest_v242-1222577163-project-member', projectid='76b6d7dab7b84017ad157933bc5f70e2', projectname='tempest-TaggedBootDevicesTest_v242-1222577163'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222241.4220662) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:41.424021 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:41.424670 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:41.425568 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:41.425753 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:41.426635 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:41.426942 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:41.427759 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:41.429110 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:41.429316 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:41.429553 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:41.429756 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:41.430187 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:41.430443 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:41.430443 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:41.430887 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:41.431096 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:41.443536 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:41.447456 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:41.458800 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:30:41.458986 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:41.459362 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:41.459740 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:41.463745 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:30:41.478218 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:41.478778 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:41.479354 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:41.479569 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:41.479875 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:41.480067 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:41.495020 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:41.495020 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:41.500166 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:41.500166 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260] added Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:41.509503 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:41.509940 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:41.510018 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:41.510235 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260] added Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:41.513363 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:41.513525 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:41.514753 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:41.514753 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:41.535352 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:41.552520 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:41.921047 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:41.927665 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:41.962103 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] During sync_power_state the instance has a pending task (rescuing). Skip. Jul 05 03:30:42.064635 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.626s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:42.065070 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:42.125251 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Updating instance_info_cache with network_info: [{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:42.287085 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:42.433336 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updated VIF entry in instance network info cache for port 21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:30:42.433965 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:42.510654 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:42.514190 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:42.520607 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:42.527591 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:42.532406 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:42.538690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:42.545287 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:42.545287 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:42.545477 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:42.545477 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:42.545630 np0000004562 nova-compute[99148]: WARNING os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:30:42.545630 np0000004562 nova-compute[99148]: Jul 05 03:30:42.551944 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:42.551944 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:42.552181 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:30:42.552181 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:42.552350 np0000004562 nova-compute[99148]: WARNING os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:30:42.552350 np0000004562 nova-compute[99148]: Jul 05 03:30:42.571222 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:42.571627 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:42.571925 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:42.572099 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:42.627033 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-4d856996-148c-4732-9428-4f5611315969" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:42.682702 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87700afdc5b8465bb1fb235e2ebf6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3465ef2c67b48a5a9eeb4bea4ff9fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:42.936008 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b549e64a-15c6-46e1-b4c7-1e4977b038c8 req-9fa5743a-1093-4c82-b687-39e1c3994d35 service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:43.078350 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:43.148648 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Successfully created port: e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:43.447022 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:43.583859 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.50.100,3260] Jul 05 03:30:43.583859 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.50.100,3260] successful. Jul 05 03:30:43.583859 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:43.584580 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.40.100,3260] Jul 05 03:30:43.584580 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.40.100,3260] successful. Jul 05 03:30:43.584580 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:43.592293 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:43.600980 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:43.613869 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.619796 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:43.620322 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.141s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:43.620662 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:43.621385 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:43.621545 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:43.631296 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.631296 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.631296 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:43.631490 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.631490 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:43.631490 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:43.631865 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.152s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:43.632032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:43.633120 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:43.635388 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:43.649863 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: None {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:43.658908 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:43.658908 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:43.782184 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Successfully updated port: e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:43.856016 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Received event network-changed-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:43.856016 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Refreshing instance network info cache due to event network-changed-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:43.856016 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] Acquiring lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:43.856016 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] Acquired lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:43.856016 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Refreshing network info cache for port e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:44.100570 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Booting with blank volume at /dev/vda Jul 05 03:30:44.252324 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:44.252324 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:44.290679 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:44.361427 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:44.457746 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:44.560433 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999720000000025 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:44.561008 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99913805899996 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:44.561105 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999003549999998 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:44.562664 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance destroyed successfully. Jul 05 03:30:44.563122 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:44.642089 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:44.643622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:44.643940 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:45.067296 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Attempting rescue Jul 05 03:30:45.067296 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:30:45.070024 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:30:45.072510 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Creating image(s) Jul 05 03:30:45.072510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:45.072510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:45.072510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:45.072510 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:45.144732 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-73b991fc-e25b-4392-bd2c-131daad92ced req-ab53af11-feb4-4a46-a7f0-6aab1751cd1b service nova] Releasing lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:45.145292 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:45.145545 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:45.226034 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:45.498192 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Found WWN 3300000008f51efd0 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:30:45.498192 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:45.498192 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== connect_volume: return (4039ms) {'type': 'block', 'scsi_wwn': '3300000008f51efd0', 'path': '/dev/dm-0', 'multipath_id': '3300000008f51efd0'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:45.498192 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f51efd0', 'path': '/dev/dm-0', 'multipath_id': '3300000008f51efd0'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:30:45.573676 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:45.574345 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:45.577559 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:45.578577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:45.579134 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:45.579442 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:45.583224 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:45.583823 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:45.671634 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:45.672196 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:45.711053 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue" returned: 0 in 0.039s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:45.711829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.133s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:45.711910 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'migration_context' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:45.736777 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:45.909953 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:46.003670 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:30:46.004374 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:46.004687 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:46.005350 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:46.005625 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:30:46.016892 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:46.017892 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:46.018647 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:46.018918 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:46.019258 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:46.019424 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:46.031628 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:46.031628 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:46.032973 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:46.032973 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae] added Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:46.047575 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:46.047905 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:46.048128 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:46.048128 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae] added Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:46.051738 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:46.051987 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:46.052034 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:46.052157 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:46.063353 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating instance_info_cache with network_info: [{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:46.214857 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:46.215375 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:46.215632 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start _get_guest_xml network_info=[{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:0a:c8:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:46.215806 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:46.276318 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:46.566587 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:46.566923 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance network_info: |[{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:46.717489 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:46.719230 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:46.720583 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1704808838', uuid='4d856996-148c-4732-9428-4f5611315969'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:0a:c8:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222246.7202268) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:46.721393 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:46.721732 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:46.722390 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:46.722555 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:46.723570 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:46.724012 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:46.724224 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:46.724348 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:46.724521 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:46.724630 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:46.724759 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:46.724934 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:46.725053 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:46.725228 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:46.725355 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:46.725499 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:46.725673 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:47.048603 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:47.052611 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:47.067574 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:47.074411 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.084380 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.092734 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.098260 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.098260 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.098260 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:47.098421 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.098421 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.098421 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:47.107069 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.107069 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.107069 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:47.107262 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.107262 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.107262 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:47.131340 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.40.100,3260] Jul 05 03:30:47.131340 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.40.100,3260] successful. Jul 05 03:30:47.131340 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.142888 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.151668 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.50.100,3260] Jul 05 03:30:47.151668 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.50.100,3260] successful. Jul 05 03:30:47.151668 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.156827 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.156827 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.156827 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.156827 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.156827 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:47.157062 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.157062 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.157062 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.157062 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.157062 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:47.157216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:47.157281 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:47.157848 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:47.157948 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:47.164134 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:47.178291 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:47.178291 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:47.180071 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.180071 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.180071 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.180071 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.180071 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:47.180276 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.180276 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:47.180276 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.180276 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:47.180276 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:47.180603 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:47.180753 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:47.181425 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:47.181584 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:47.199550 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:47.201433 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:47.230866 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:47.242781 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704808838',display_name='tempest-ServerRescueNegativeTestJSON-server-1704808838',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-1704808838',id=10,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:30:40Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-m0bw230r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:40Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=4d856996-148c-4732-9428-4f5611315969,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:0a:c8:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:47.242971 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:0a:c8:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:47.243455 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:47.244020 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:47.525091 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:47.537477 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:30:47.555685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:47.580048 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:30:47.580458 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:30:47.587908 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:30:47.590357 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6'] Jul 05 03:30:47.590470 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:30:47.590566 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:30:47.591122 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:47.591352 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating existing volume attachment record: 6a59cbf0-8761-4a39-9cb3-127de31d90fb {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:30:47.612535 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:47.612825 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:47.748950 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] End _get_guest_xml xml= Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: instance-0000000a Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-1704808838 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 2026-07-05 03:30:46 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: True Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: bare Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: ide Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: pc Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: Jul 05 03:30:47.750059 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:47.752769 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance destroyed successfully. Jul 05 03:30:48.019421 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:30:48.114818 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:30:48.668956 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:48.669466 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:48.671655 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:30:48.671953 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Claim successful on node np0000004562 Jul 05 03:30:49.033453 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Found WWN 330000000aaec149b for multipath device dm-3 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:30:49.033778 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:49.033932 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000aaec149b', 'path': '/dev/dm-3', 'multipath_id': '330000000aaec149b'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:49.034066 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000aaec149b', 'path': '/dev/dm-3', 'multipath_id': '330000000aaec149b'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:30:49.268604 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:49.268792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:49.268904 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:49.269028 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:0a:c8:e6, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:49.269515 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Using config drive Jul 05 03:30:49.537523 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:30:49.537894 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:49.538051 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:49.538536 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:49.538787 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:30:49.549628 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:49.550266 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:49.550780 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:49.550979 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:49.551385 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:49.551940 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:49.563739 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:49.563739 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:49.564963 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:49.564963 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf] added Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:49.574967 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:49.575285 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:49.575358 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf] added Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:49.578796 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:49.579048 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:49.579112 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:49.579213 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:49.701585 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:49.702551 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:49.702790 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Creating image(s) Jul 05 03:30:49.703104 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:30:49.703338 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Ensure instance console log exists: /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:49.703597 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:49.703748 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:49.703863 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:49.704300 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start _get_guest_xml network_info=[{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6a59cbf0-8761-4a39-9cb3-127de31d90fb', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a123d3ff-9f01-46b6-838c-11bc579124ec', 'attached_at': '', 'detached_at': '', 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'serial': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:49.706112 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:49.707150 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095', uuid='a123d3ff-9f01-46b6-838c-11bc579124ec'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222249.7068262) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:49.709822 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:49.710150 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:49.710896 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:49.711044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:49.712044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:49.712320 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:49.712799 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:49.712799 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:49.712799 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:49.712799 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:49.712799 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:49.713006 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:49.713006 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:49.713117 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:49.713235 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:49.713344 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:49.722905 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:30:49.725760 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:30:49.726002 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:49.771920 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:50.193786 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:50.194017 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:50.228321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:50.278636 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:50.278813 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'keypairs' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:50.575832 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:50.579667 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:50.587632 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:50.595042 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.600302 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.610742 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.617688 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.617688 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.617688 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.617688 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.617688 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:50.617985 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.617985 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.617985 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.617985 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.617985 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:50.625626 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.625626 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.625626 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.625626 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.625626 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:50.625830 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.625830 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.625830 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.625830 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.625830 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:50.651622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.40.100,3260] Jul 05 03:30:50.651622 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.40.100,3260] successful. Jul 05 03:30:50.651622 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.663995 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.668487 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.50.100,3260] Jul 05 03:30:50.668487 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.50.100,3260] successful. Jul 05 03:30:50.668487 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.680606 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.680910 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:50.681211 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:50.681541 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:50.681966 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:50.683177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:50.683343 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:50.696616 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.702545 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:50.703565 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:50.704139 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:50.704285 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:50.705102 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:50.706265 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:50.706265 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:50.706265 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:50.724700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:50.724700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:50.790531 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<4d856996-148c-4732-9428-4f5611315969> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:30:50.794255 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:50.939801 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Creating config drive at /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config.rescue Jul 05 03:30:50.942936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3h2r_0n {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:50.977980 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3h2r_0n" returned: 0 in 0.035s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:50.996761 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.997190 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.997413 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.997614 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.997851 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.998065 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.998791 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:50.998791 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:30:50.998791 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:51.205970 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.537s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:51.206654 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:30:51.289687 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:51.434597 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:51.442765 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:51.502893 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:51.503088 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:51.503241 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:51.503391 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:30:51.551664 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:30:51.713871 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:30:51.714383 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:30:51.714436 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:51.714701 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:51.799914 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '073872262a6341338d468bb869b1bf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55da77bd22354fce84a6e3ff834c8d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:30:52.218380 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:30:52.246826 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Successfully created port: 5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:30:52.330917 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 4d856996-148c-4732-9428-4f5611315969 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:30:52.331130 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:52.331336 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Resumed (Lifecycle Event) Jul 05 03:30:52.333543 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-cf0f425c-b371-48f6-be92-35e68159fba9 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:52.569009 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Found WWN 3300000007fda16e8 for multipath device dm-4 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:30:52.569730 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:52.570013 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000007fda16e8', 'path': '/dev/dm-4', 'multipath_id': '3300000007fda16e8'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:52.570207 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fda16e8', 'path': '/dev/dm-4', 'multipath_id': '3300000007fda16e8'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:30:52.570853 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.845s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:52.571177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:30:52.587741 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:52.599742 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:52.599742 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:52.604559 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:30:52.604559 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7] added Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:52.614848 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:52.616855 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7] added Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:30:52.617403 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:52.617642 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:30:52.617910 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:30:52.618396 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:30:52.704296 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:52.704765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:52.723538 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:30:52.785113 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Successfully updated port: 5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:30:52.804215 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:52.806792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:52.835525 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:52.836982 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:52.849353 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-changed-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:52.849494 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Refreshing instance network info cache due to event network-changed-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:30:52.849707 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] Acquiring lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:52.850324 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] Acquired lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:52.850490 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Refreshing network info cache for port 5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:30:52.880277 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:52.880886 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:52.958633 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:52.961232 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.029763 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.030189 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.078737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.078994 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.081174 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.082327 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.082546 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.086308 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.087407 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.087624 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.088209 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.089073 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.089265 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.092967 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.095785 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.095988 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.096542 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.097390 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.099310 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.100503 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.101107 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.101987 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:53.102191 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.102647 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.107545 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f4104ac-fa7c-495a-9f64-c9b835bc6073 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:53.111323 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.187431 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.187984 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.259707 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.263409 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.290169 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:53.336125 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.336538 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.357090 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:53.357379 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Started (Lifecycle Event) Jul 05 03:30:53.360740 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:53.410734 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.413414 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.428896 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:53.483140 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.069s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.483407 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.582160 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:53.584391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.585512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] End _get_guest_xml xml= Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 7f4104ac-fa7c-495a-9f64-c9b835bc6073 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: instance-00000008 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: tempest-device-tagging-server-1167103678 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 2026-07-05 03:30:41 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: True Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: bare Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: tempest-TaggedBootDevicesTest_v242-1222577163-project-member Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: tempest-TaggedBootDevicesTest_v242-1222577163 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 7f4104ac-fa7c-495a-9f64-c9b835bc6073 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 7f4104ac-fa7c-495a-9f64-c9b835bc6073 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: d0e67fcf-50f9-4356-986d-13c7a918e260 Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: 5c0b1bcc-d802-42f4-9516-cea433ce2cdf Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: Jul 05 03:30:53.614310 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.617430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.618037 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.618037 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.618037 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.618164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.618372 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.618515 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.618687 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.618853 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.619286 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:30:53.619728 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.620052 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:30:53.624185 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.624401 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.004s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.624572 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.624961 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Preparing to wait for external event network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:53.625090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.625247 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.625398 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.626447 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:53.626707 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.627577 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.628203 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:53.629143 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.629664 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.630117 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:53.631112 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.631298 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8def492b-2d3c-54a3-9d3d-1bca51d3b0fb', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:53.635776 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:30:53.638152 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.645308 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.647163 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.647163 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.648930 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.649279 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.649493 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cb05efe-1c, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.649894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cb05efe-1c, col_values=(('qos', UUID('8eb4d151-6595-41e2-b56e-56341b86da8a')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.650079 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cb05efe-1c, col_values=(('external_ids', {'iface-id': '7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:d0:26', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.650898 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.654124 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.654903 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.660745 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.671748 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.687889 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:53.699732 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.703848 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.703848 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:53.706187 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.706567 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2019b21-d523-526b-948c-aa21924a6ba3', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.710291 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.712193 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.714879 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.40.100,3260] Jul 05 03:30:53.714879 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.40.100,3260] successful. Jul 05 03:30:53.714879 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.715517 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.715803 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb2e32c9-49, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.716242 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb2e32c9-49, col_values=(('qos', UUID('8feb40d9-3cee-49b5-b466-e81cad9cef13')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.716518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb2e32c9-49, col_values=(('external_ids', {'iface-id': 'bb2e32c9-4929-4707-8b62-218476108cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:08:3c', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.720796 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.725985 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.728742 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.734012 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.50.100,3260] Jul 05 03:30:53.734012 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.50.100,3260] successful. Jul 05 03:30:53.734012 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.734012 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.735664 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') Jul 05 03:30:53.735664 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:53.735977 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.736384 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.736881 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:53.738797 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.738797 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.738797 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:53.741695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.741930 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '993e839c-dc6f-52a1-89a3-bac7ab32a1df', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.745210 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:30:53.754732 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:30:53.758612 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.765106 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:30:53.765490 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Creating image(s) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.766974 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:53.767253 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.767605 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:53.768198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "/opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.769377 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:53.769632 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "/opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:53.769985 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:53.771732 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.776146 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:30:53.776391 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:30:53.777510 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:53.777804 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:53.778497 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:53.781315 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:30:53.782108 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:30:53.782198 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:30:53.784600 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:53.786038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8af0e9b1-6c, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8af0e9b1-6c, col_values=(('qos', UUID('b784d037-5d00-4aa4-aec1-e3daf51bb28e')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8af0e9b1-6c, col_values=(('external_ids', {'iface-id': '8af0e9b1-6c97-4f9b-87b9-335bb6c672ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:2c:c2', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:53.883518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4d856996-148c-4732-9428-4f5611315969] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:53.894181 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.107s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.895118 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:53.897977 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:53.897977 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:53.903837 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.907637 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:30:53.907637 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:30:53.912036 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:30:53.912788 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.928927 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.938019 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') Jul 05 03:30:53.938019 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:53.943810 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:53.943810 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:53.946479 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.946842 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:53.949024 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:53.949280 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.949507 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.949755 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:53.951963 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:53.952161 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.952503 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6135f57-7b2a-586a-ac2d-401b0bb75b57', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:53.968641 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.971190 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:53.990673 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:53.991039 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap924b28f4-27, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.002182 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap924b28f4-27, col_values=(('qos', UUID('cee89df6-a933-48f2-a104-bb00c1f91127')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.003828 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap924b28f4-27, col_values=(('external_ids', {'iface-id': '924b28f4-27f7-4a6b-aa53-667cdcec6779', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:e8:17', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.019530 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f772c163-4608-4eab-ad0f-2967b2c3d6f3 req-389d0edb-1ad9-40b7-9ceb-ea01f61c92d4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.020243 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f772c163-4608-4eab-ad0f-2967b2c3d6f3 req-389d0edb-1ad9-40b7-9ceb-ea01f61c92d4 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.021917 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.108s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.022458 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.022681 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f772c163-4608-4eab-ad0f-2967b2c3d6f3 req-389d0edb-1ad9-40b7-9ceb-ea01f61c92d4 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.023237 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f772c163-4608-4eab-ad0f-2967b2c3d6f3 req-389d0edb-1ad9-40b7-9ceb-ea01f61c92d4 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.023237 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f772c163-4608-4eab-ad0f-2967b2c3d6f3 req-389d0edb-1ad9-40b7-9ceb-ea01f61c92d4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:54.025049 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.038632 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.054758 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.060562 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') Jul 05 03:30:54.061904 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:54.062195 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:54.071372 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:54.073018 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:54.081142 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.084673 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.084673 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:54.086464 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.086464 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d1cc3f3-1682-506d-9dbf-89cede8abacf', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.088903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.097178 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.097178 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk 1073741824" returned: 0 in 0.072s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.097178 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1608bdaf-8c92-4be4-b617-ad6de1f1e315 req-ede96ef1-b878-43a5-b0e7-5a6840447dda service nova] Releasing lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:54.103470 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquired lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:54.104198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.207s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.104198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.106430 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:54.107409 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.112285 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.139596 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86bf53df-be, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.141157 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86bf53df-be, col_values=(('qos', UUID('b13a60d1-b5a6-4d09-a362-c08a1b27ab16')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.141484 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86bf53df-be, col_values=(('external_ids', {'iface-id': '86bf53df-be71-4602-af51-8fdc20c2874d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:29:d3', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.147755 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.151925 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.162268 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.179468 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') Jul 05 03:30:54.180770 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:54.181021 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:54.184227 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:54.184958 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:54.186951 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.186951 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.186951 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:54.195289 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.196816 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b15b1fa2-1160-57d9-8d0e-ed8f4479c23c', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.200124 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.202292 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.211252 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.211386 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.216456 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap746e6639-5d, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.216735 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap746e6639-5d, col_values=(('qos', UUID('71f571bf-2ffe-4544-92c9-000f54854170')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.217241 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap746e6639-5d, col_values=(('external_ids', {'iface-id': '746e6639-5d12-4455-a62c-e72b29391501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:aa:9b', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.220137 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.220908 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.225237 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.237723 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.244742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.139s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.246597 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:30:54.248113 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.278651 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.290906 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') Jul 05 03:30:54.290906 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:54.290906 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:54.290906 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:54.294383 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:54.296413 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.296626 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.296933 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:54.302229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.302229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a36345c3-d471-575a-a499-505cf7105faa', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.304588 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.305961 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.326006 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.330304 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:54.330521 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:54.345199 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.347027 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Cannot resize image /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:30:54.348808 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:30:54.349157 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Ensure instance console log exists: /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:30:54.350148 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.351287 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.351496 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.351893 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.357663 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.357968 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21b31dbd-b1, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.358812 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21b31dbd-b1, col_values=(('qos', UUID('b43390af-e4b3-44ba-8053-e3dafcb76bae')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.358812 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21b31dbd-b1, col_values=(('external_ids', {'iface-id': '21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:0b:12', 'vm-uuid': '7f4104ac-fa7c-495a-9f64-c9b835bc6073'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:54.364453 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:54.367273 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:54.370421 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=50605MB free_disk=74.4998664855957GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:30:54.370421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.370421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.372899 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.384018 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.392140 np0000004562 nova-compute[99148]: INFO os_vif [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') Jul 05 03:30:54.413565 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.420725 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.587253 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:30:54.644413 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c0eac5cf-263a-4337-8d6b-0a0be350d679 req-2564663a-6d86-41ee-9655-18d2f0a83bbf service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.644623 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0eac5cf-263a-4337-8d6b-0a0be350d679 req-2564663a-6d86-41ee-9655-18d2f0a83bbf service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.645077 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0eac5cf-263a-4337-8d6b-0a0be350d679 req-2564663a-6d86-41ee-9655-18d2f0a83bbf service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.645077 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0eac5cf-263a-4337-8d6b-0a0be350d679 req-2564663a-6d86-41ee-9655-18d2f0a83bbf service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.645077 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c0eac5cf-263a-4337-8d6b-0a0be350d679 req-2564663a-6d86-41ee-9655-18d2f0a83bbf service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:54.719129 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.724201 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.750254 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:54.753949 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:30:54.870776 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ba38bf45-fe23-413f-8a73-b4de27c5f4d5 req-48ccf6b1-6bcc-4b0f-bc04-0e8bbbe6ea54 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.871346 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ba38bf45-fe23-413f-8a73-b4de27c5f4d5 req-48ccf6b1-6bcc-4b0f-bc04-0e8bbbe6ea54 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.871782 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ba38bf45-fe23-413f-8a73-b4de27c5f4d5 req-48ccf6b1-6bcc-4b0f-bc04-0e8bbbe6ea54 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.871925 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ba38bf45-fe23-413f-8a73-b4de27c5f4d5 req-48ccf6b1-6bcc-4b0f-bc04-0e8bbbe6ea54 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.872314 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ba38bf45-fe23-413f-8a73-b4de27c5f4d5 req-48ccf6b1-6bcc-4b0f-bc04-0e8bbbe6ea54 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:54.929505 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec in dict_keys([('network-vif-plugged', 'bb2e32c9-4929-4707-8b62-218476108cc2'), ('network-vif-plugged', '86bf53df-be71-4602-af51-8fdc20c2874d'), ('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-8af0e9b1-6c97-4f9b-87b9-335bb6c672ec for instance with vm_state building and task_state spawning. Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.931736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.932227 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.932337 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:54.932507 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:54.932674 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:54.933180 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:54.933312 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:54.933449 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d in dict_keys([('network-vif-plugged', 'bb2e32c9-4929-4707-8b62-218476108cc2'), ('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:54.933675 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1d15053e-67b3-482f-83ea-b48bd52de8fe req-336cc094-5eff-4f76-8685-ac3bdbbbb6c9 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-86bf53df-be71-4602-af51-8fdc20c2874d for instance with vm_state building and task_state spawning. Jul 05 03:30:54.959132 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:55.019753 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.020352 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.126396 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Updating instance_info_cache with network_info: [{"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:55.180945 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.341727 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.342782 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.533592 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance d22f1b3c-5d43-486e-a417-325d749fca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.533814 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 56f86925-1417-4995-8ffe-d5c410bc7613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.533974 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance d5282468-599f-4af3-b640-af72408dd7d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534122 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance dceabcd9-3341-412c-8492-121a739b626d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534249 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance a5af3d1a-6bd5-427a-90fd-2a464878e157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534369 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 8925c8cc-b844-4697-9d32-99d9b39c394f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534489 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 7f4104ac-fa7c-495a-9f64-c9b835bc6073 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534609 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 79dcf4df-1d4d-462e-9b02-4bf431533787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.534940 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 4d856996-148c-4732-9428-4f5611315969 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.535114 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance a123d3ff-9f01-46b6-838c-11bc579124ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.535276 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance ee8c5417-25e7-44b1-847c-6c989397ec07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:30:55.535528 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 11 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:30:55.535700 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=2624MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:30:54 up 27 min, 2 users, load average: 6.92, 3.30, 1.58\n', 'num_instances': '11', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '11', 'num_proj_c3465ef2c67b48a5a9eeb4bea4ff9fff': '2', 'io_workload': '3', 'num_proj_026b2963073e4b6ca4fa964dbc89d833': '1', 'num_proj_18996417885c4ff8b2c6ec2fa2563e43': '1', 'num_proj_8f15da77ec4e4a65bcdd563097de4c3b': '1', 'num_proj_3821d2d075c94e5499a469f3ef5e7c47': '2', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_76b6d7dab7b84017ad157933bc5f70e2': '1', 'num_proj_e31f3215e6204f19859b8f62235b8cb7': '2', 'num_vm_rescued': '1', 'num_proj_55da77bd22354fce84a6e3ff834c8d0f': '1'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:30:55.604112 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Found WWN 330000000e226bb4b for multipath device dm-5 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:30:55.604508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:30:55.604881 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== connect_volume: return (5879ms) {'type': 'block', 'scsi_wwn': '330000000e226bb4b', 'path': '/dev/dm-5', 'multipath_id': '330000000e226bb4b'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:30:55.605066 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e226bb4b', 'path': '/dev/dm-5', 'multipath_id': '330000000e226bb4b'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:30:55.628725 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Releasing lock "refresh_cache-ee8c5417-25e7-44b1-847c-6c989397ec07" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:55.629016 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance network_info: |[{"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:30:55.630743 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Start _get_guest_xml network_info=[{"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:30:55.633389 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:30:55.633389 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1549977290', uuid='ee8c5417-25e7-44b1-847c-6c989397ec07'), owner=OwnerMeta(userid='073872262a6341338d468bb869b1bf02', username='tempest-ServersNegativeTestJSON-789470158-project-member', projectid='55da77bd22354fce84a6e3ff834c8d0f', projectname='tempest-ServersNegativeTestJSON-789470158'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222255.6329389) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:30:55.634128 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:30:55.634785 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:30:55.639404 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:30:55.640883 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:30:55.661400 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549977290',display_name='tempest-ServersNegativeTestJSON-server-1549977290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-1549977290',id=12,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-j7ncgjv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:53Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=ee8c5417-25e7-44b1-847c-6c989397ec07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:55.661859 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:55.662634 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:55.663502 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lazy-loading 'pci_devices' on Instance uuid ee8c5417-25e7-44b1-847c-6c989397ec07 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:55.674993 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.676944 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.681432 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.701632 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.704961 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.923388 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.924879 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:55.926665 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:55.926966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] No BDM found with device name vdc, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:55.927087 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] No VIF found with MAC fa:16:3e:e0:d0:26, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:55.927306 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] No VIF found with MAC fa:16:3e:cc:29:d3, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:55.927841 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Using config drive Jul 05 03:30:55.996766 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Rescuing Jul 05 03:30:55.996928 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:30:55.997022 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:30:55.997168 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:30:56.071896 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.072356 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.072560 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.072735 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.072933 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 in dict_keys([('network-vif-plugged', 'bb2e32c9-4929-4707-8b62-218476108cc2'), ('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:56.073129 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 for instance with vm_state building and task_state spawning. Jul 05 03:30:56.073332 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.073595 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.073803 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.073982 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.074179 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:56.074358 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.074546 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.074916 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.075026 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.075151 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 in dict_keys([('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:56.075261 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-b9056341-e023-4915-903a-a06a1981a434 req-1244c67a-39b1-4356-a4c5-090ddfa87cac service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-bb2e32c9-4929-4707-8b62-218476108cc2 for instance with vm_state building and task_state spawning. Jul 05 03:30:56.084724 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:30:56.084966 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:30:56.111567 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-709522095',id=11,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-5s8ksnqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:44Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=a123d3ff-9f01-46b6-838c-11bc579124ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:30:56.111830 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:56.112281 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:56.112810 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] End _get_guest_xml xml= Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: ee8c5417-25e7-44b1-847c-6c989397ec07 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: instance-0000000c Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-server-1549977290 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 2026-07-05 03:30:55 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: True Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: bare Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-789470158-project-member Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-789470158 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: ee8c5417-25e7-44b1-847c-6c989397ec07 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: ee8c5417-25e7-44b1-847c-6c989397ec07 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Preparing to wait for external event network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549977290',display_name='tempest-ServersNegativeTestJSON-server-1549977290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-1549977290',id=12,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-j7ncgjv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:53Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=ee8c5417-25e7-44b1-847c-6c989397ec07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:56.171599 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:56.175237 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.175237 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.175237 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:56.176280 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.176459 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f764304-9053-51f6-bbf6-827d0aca8f16', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.177324 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.178103 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:56.178720 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.180761 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.180922 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e8f8b70-25, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.181266 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e8f8b70-25, col_values=(('qos', UUID('6441a1d0-5f6e-4527-aebb-56abc3bff2e5')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.181430 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e8f8b70-25, col_values=(('external_ids', {'iface-id': '5e8f8b70-2560-4243-8cfe-4ab4a8c8778f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:cd:0a', 'vm-uuid': 'ee8c5417-25e7-44b1-847c-6c989397ec07'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.182221 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.183695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:56.187490 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.193744 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.203562 np0000004562 nova-compute[99148]: INFO os_vif [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') Jul 05 03:30:56.227134 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.233362 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.294068 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.442648 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:56.502744 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:56.546780 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.555086 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.571498 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.589190 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] End _get_guest_xml xml= Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: instance-0000000b Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 196608 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-709522095 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 2026-07-05 03:30:49 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 192 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: True Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: bare Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 0 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: virtio Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: hvm Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 128 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 1 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: 9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: Jul 05 03:30:56.617695 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Preparing to wait for external event network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-709522095',id=11,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-5s8ksnqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:44Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=a123d3ff-9f01-46b6-838c-11bc579124ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:30:56.621255 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:30:56.622336 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:30:56.622684 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:30:56.624605 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.625258 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.625880 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:30:56.627567 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.627786 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a202091a-da55-5fa7-b897-a00b659d4251', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.629402 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.631290 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:56.636706 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Creating config drive at /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073/disk.config Jul 05 03:30:56.637830 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.640859 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.641016 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape40e5ce9-25, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.641753 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape40e5ce9-25, col_values=(('qos', UUID('002ce0d1-2c5f-424f-b703-630c53fbaa94')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.643033 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape40e5ce9-25, col_values=(('external_ids', {'iface-id': 'e40e5ce9-251f-4286-a5e0-a38e2c1a8c05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:62:be', 'vm-uuid': 'a123d3ff-9f01-46b6-838c-11bc579124ec'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:30:56.646166 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.647669 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:30:56.648905 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_jpn0tj5 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:56.661899 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.689297 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.695205 np0000004562 nova-compute[99148]: INFO os_vif [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') Jul 05 03:30:56.700311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_jpn0tj5" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:56.719566 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.723246 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.737845 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.738013 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.738232 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.740307 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.740459 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 in dict_keys([('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:56.741998 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-3f30b6c0-7a0f-4bcc-9e48-55619143f1b1 req-fae74d85-8e1f-494a-81e7-8fb7d4e64dfa service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 for instance with vm_state building and task_state spawning. Jul 05 03:30:56.873491 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.874199 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:56.962298 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:56.985666 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.986295 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.986425 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.986527 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.986646 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No event matching network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 in dict_keys([('network-vif-plugged', '746e6639-5d12-4455-a62c-e72b29391501')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:30:56.987157 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 for instance with vm_state building and task_state spawning. Jul 05 03:30:56.987157 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.987157 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.987157 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.987310 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.987350 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Processing event network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:56.987454 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:56.987589 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:56.987707 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:56.988354 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:56.988354 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:56.988354 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-c5965237-bc9c-49b6-b185-df46be5a2f59 req-882d420c-b2a9-4cbc-92f7-72d7c4bc4d5e service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received unexpected event network-vif-plugged-746e6639-5d12-4455-a62c-e72b29391501 for instance with vm_state building and task_state spawning. Jul 05 03:30:57.100979 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:30:57.102348 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:57.102348 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.67 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:30:57.119447 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Updating instance_info_cache with network_info: [{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:30:57.163946 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.176300 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.279939 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.289022 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.368631 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.377927 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.458284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.471473 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.548222 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.558251 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.622432 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:30:57.651698 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.664115 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.725125 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:57.725243 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:57.725301 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No VIF found with MAC fa:16:3e:57:cd:0a, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:57.725748 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Using config drive Jul 05 03:30:57.766110 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:57.780324 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Processing event network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:58.139974 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] No waiting events found dispatching network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received unexpected event network-vif-plugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f for instance with vm_state building and task_state spawning. Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Received event network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:58.140929 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:58.141312 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:58.141312 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Processing event network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:30:58.141677 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Received event network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:30:58.141677 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:58.141814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:58.141936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:30:58.142061 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] No waiting events found dispatching network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:30:58.142204 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-433087ea-0b4a-44d0-a28d-fc42342ce347 req-3cc61507-0b88-49db-9256-dd7a8f9c4f8c service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Received unexpected event network-vif-plugged-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 for instance with vm_state building and task_state spawning. Jul 05 03:30:58.222775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:58.222775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:30:58.222775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:fe:62:be, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:30:58.222775 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Using config drive Jul 05 03:30:58.231592 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:58.364328 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Creating config drive at /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.config Jul 05 03:30:58.367779 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfdnsynmi {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:58.415832 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfdnsynmi" returned: 0 in 0.045s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:58.543909 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:58.546172 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:58.546172 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] VM Started (Lifecycle Event) Jul 05 03:30:58.551670 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:58.555253 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance spawned successfully. Jul 05 03:30:58.558025 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:58.594818 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:30:58.595208 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:30:58.728308 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:30:58.920622 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:59.021502 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Creating config drive at /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config Jul 05 03:30:59.028313 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxky6twt6 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:30:59.049925 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:59.054695 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:30:59.069486 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.069931 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.070480 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.071518 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.072146 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.072547 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:30:59.079776 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxky6twt6" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:30:59.098803 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lazy-loading 'flavor' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:30:59.269438 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:59.276361 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:59.512827 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:59.526032 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:30:59.557726 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:30:59.557726 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:30:59.557726 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] VM Paused (Lifecycle Event) Jul 05 03:30:59.561012 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000887700000021141 future=) was cancelled during its delay period, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:59.561142 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:30:59.581930 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Took 25.61 seconds to spawn the instance on the hypervisor. Jul 05 03:30:59.581930 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:30:59.655766 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:30:59.657683 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:30:59.659261 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance spawned successfully. Jul 05 03:30:59.659575 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:30:59.721851 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance destroyed successfully. Jul 05 03:30:59.722284 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'numa_topology' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:00.059455 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:00.062480 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:00.062971 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] VM Resumed (Lifecycle Event) Jul 05 03:31:00.094850 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Took 37.84 seconds to build instance. Jul 05 03:31:00.105258 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:00.169526 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.169647 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.169987 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.170284 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.170563 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.170856 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.225933 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Attempting rescue Jul 05 03:31:00.226435 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:31:00.230348 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:31:00.230348 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Creating image(s) Jul 05 03:31:00.230999 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:00.231213 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:00.231629 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:00.231980 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'trusted_certs' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:00.360703 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:31:00.362592 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:31:00.365174 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance spawned successfully. Jul 05 03:31:00.365601 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:31:00.565920 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:00.566854 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:00.597063 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 39.348s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:00.679389 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Took 6.94 seconds to spawn the instance on the hypervisor. Jul 05 03:31:00.679614 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:00.735550 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:00.736383 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:00.744939 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:00.746260 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:00.746692 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:00.747082 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:00.751686 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:00.752749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:00.834742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:00.834742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:00.875096 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.875458 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.875728 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.876036 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.876380 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.876723 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:00.890206 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.rescue" returned: 0 in 0.056s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:00.890933 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.144s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:00.891203 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'migration_context' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:01.069402 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:01.069590 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] VM Started (Lifecycle Event) Jul 05 03:31:01.188069 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Took 12.57 seconds to build instance. Jul 05 03:31:01.298393 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:01.343682 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:01.346742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:01.385228 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Took 11.68 seconds to spawn the instance on the hypervisor. Jul 05 03:31:01.385551 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:01.393268 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:01.393541 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:31:01.394084 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start _get_guest_xml network_info=[{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:f9:d2:46"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:01.394268 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:01.534518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-changed-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:01.534518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing instance network info cache due to event network-changed-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:01.534518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] Acquiring lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:01.534518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] Acquired lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:01.534518 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Refreshing network info cache for port 7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:01.540953 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:01.541276 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:01.541489 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Attaching volume 437e95a7-c3d5-428d-9a9d-dd15b3f10caf to /dev/vdb Jul 05 03:31:01.572667 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:01.574274 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:01.590323 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:01.600742 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:01.628793 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:01.652653 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:01.653010 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:01.653759 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:01.666592 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:01.670080 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be'] Jul 05 03:31:01.670255 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:01.670358 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:01.670628 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:01.670961 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updating existing volume attachment record: 210b9f76-872e-478d-8dca-0ba6420f10db {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:01.694567 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.082s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:01.850286 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lazy-loading 'flavor' on Instance uuid dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:01.899173 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:01.899910 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Took 22.53 seconds to build instance. Jul 05 03:31:01.903919 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:01.905676 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-449495268', uuid='79dcf4df-1d4d-462e-9b02-4bf431533787'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:f9:d2:46"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222261.9051838) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:01.906888 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:01.907387 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:01.910268 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:01.910788 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:01.912454 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:01.912914 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:01.913118 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:01.913237 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:01.913420 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:01.913561 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:01.913641 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:01.914255 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:01.914397 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:01.914865 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:01.915022 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:01.915588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:01.915797 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'vcpu_model' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:02.036901 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:02.077240 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:02.077240 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] VM Paused (Lifecycle Event) Jul 05 03:31:02.278124 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:02.279259 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:02.279457 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:02.284079 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:02.284620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:02.294340 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:02.294796 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:02.295193 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:02.295378 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:02.296050 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:02.296318 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:02.311226 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:02.311226 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:02.321655 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:02.321655 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf] added Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:02.326644 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:02.326924 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:02.327016 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf] added Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:02.335725 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:02.335990 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:02.336103 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:02.336222 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:02.385940 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:02.401429 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.041s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:02.418237 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:02.429842 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449495268',display_name='tempest-ServerRescueNegativeTestJSON-server-449495268',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-449495268',id=9,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:30:37Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-kay3kuuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:30:38Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=79dcf4df-1d4d-462e-9b02-4bf431533787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:f9:d2:46"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:02.429996 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:f9:d2:46"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:02.430553 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:02.431110 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:02.506616 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updated VIF entry in instance network info cache for port 7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:31:02.507132 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [{"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:02.581089 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:02.583499 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:02.583499 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] VM Resumed (Lifecycle Event) Jul 05 03:31:02.835225 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:02.835412 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:02.856948 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:02.932672 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] End _get_guest_xml xml= Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: instance-00000009 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 196608 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-449495268 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 2026-07-05 03:31:01 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 192 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: True Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: bare Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: ide Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: pc Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: Jul 05 03:31:02.933825 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:02.936277 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance destroyed successfully. Jul 05 03:31:03.009163 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6c22771-94b3-41f9-8782-8be727768452 req-a0e46c09-b690-4616-ae1d-458e88d9004d service nova] Releasing lock "refresh_cache-7f4104ac-fa7c-495a-9f64-c9b835bc6073" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:03.085264 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:03.086482 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:03.327502 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:03.337062 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:03.337205 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:03.341460 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:03.350354 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.361737 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.363612 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.378826 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.379142 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.391094 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.391820 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:03.424155 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.40.100,3260] Jul 05 03:31:03.424155 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.40.100,3260] successful. Jul 05 03:31:03.424155 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.439277 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.455007 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.50.100,3260] Jul 05 03:31:03.455007 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.50.100,3260] successful. Jul 05 03:31:03.455007 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.463205 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.464369 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:03.464772 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:03.464969 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:03.466739 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:03.469406 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:03.469604 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Scanning host 15 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.483854 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:03.484261 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:03.484546 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:03.484546 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:03.485653 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:03.485778 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Scanning host 16 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:03.494472 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:03.494472 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:03.500999 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:03.501155 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:03.546242 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Rescuing Jul 05 03:31:03.546447 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:03.546542 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:03.546683 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:03.589877 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999662133000129 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:03.590051 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:03.590624 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Started (Lifecycle Event) Jul 05 03:31:03.590998 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998534487999905 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:03.592470 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997041844000023 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:03.608194 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:03.608541 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:03.885483 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:03.885483 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:03.889536 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:03.889536 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Claim successful on node np0000004562 Jul 05 03:31:03.966799 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:03.966987 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:03.967180 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Attaching volume aaa93144-80be-4be9-aa5d-81289064b5bb to /dev/sdc Jul 05 03:31:04.004635 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:04.015478 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:04.033619 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:04.051258 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:04.059667 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:04.059949 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:04.069965 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:04.071684 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be'] Jul 05 03:31:04.071835 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:04.071937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:04.072160 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:04.072368 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updating existing volume attachment record: 7edd5904-9bd8-4868-887d-caa36fe3aadb {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:04.094374 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:04.100234 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:04.115803 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'flavor' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:04.296327 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:04.391240 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:04.457781 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:04.457976 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:04.458268 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:04.458268 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:f9:d2:46, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:04.458889 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Using config drive Jul 05 03:31:04.548316 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating instance_info_cache with network_info: [{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:04.603405 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] During sync_power_state the instance has a pending task (rescuing). Skip. Jul 05 03:31:04.603579 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:04.603638 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Paused (Lifecycle Event) Jul 05 03:31:04.639572 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:04.639890 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:04.640053 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:04.966075 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'ec2_ids' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:05.050742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:05.105821 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:05.106940 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:05.107114 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Resumed (Lifecycle Event) Jul 05 03:31:05.119286 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:05.314379 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Found WWN 330000000c24ab7be for multipath device dm-6 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:05.314862 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:05.315126 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000c24ab7be', 'path': '/dev/dm-6', 'multipath_id': '330000000c24ab7be'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:05.315292 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c24ab7be', 'path': '/dev/dm-6', 'multipath_id': '330000000c24ab7be'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:05.315821 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.676s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:05.316167 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:05.321581 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lazy-loading 'flavor' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:05.329125 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:05.329997 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:05.330670 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:05.330913 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:05.331364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:05.332207 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:05.349333 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:05.349333 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:05.356330 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:05.356330 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb] added Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:05.365542 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:05.367485 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:05.367485 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:05.367485 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb] added Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:05.369777 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:05.370018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:05.370173 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:05.370333 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:05.469255 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:05.469776 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'keypairs' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:05.560689 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:05.560986 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:05.611395 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:05.615329 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:05.824729 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Attempting to attach volume 437e95a7-c3d5-428d-9a9d-dd15b3f10caf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] attach device xml: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: 437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: Jul 05 03:31:05.825614 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:31:05.972357 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:05.977124 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:06.063816 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:06.121195 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] During sync_power_state the instance has a pending task (rescuing). Skip. Jul 05 03:31:06.147345 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Creating config drive at /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config.rescue Jul 05 03:31:06.150392 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps2sow7x6 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:06.183904 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps2sow7x6" returned: 0 in 0.033s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:06.302213 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:06.366550 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:06.370769 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:06.381159 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:06.385264 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.393948 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.399497 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.411213 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.411628 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.417746 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.417973 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:06.461671 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.40.100,3260] Jul 05 03:31:06.461671 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.40.100,3260] successful. Jul 05 03:31:06.461671 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.473377 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.480123 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.50.100,3260] Jul 05 03:31:06.480123 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.50.100,3260] successful. Jul 05 03:31:06.480123 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.491325 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.493815 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.494274 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:06.494611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:06.494611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:06.495701 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:06.495901 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:06.513365 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:06.513365 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.521063 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:06.521448 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:06.522135 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:06.522645 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:06.522759 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:06.544387 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:06.544387 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:06.580631 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.695s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:06.581208 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:31:06.606421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:06.606636 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:06.606954 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attaching volume 63ed7b16-387c-4938-9d2e-0f4c344e1ee2 to /dev/vdb Jul 05 03:31:06.653756 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:06.668387 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:06.678523 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:06.684238 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:06.696219 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:06.711733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:06.738489 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:06.739958 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:06.748623 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:06.753400 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be'] Jul 05 03:31:06.753671 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:06.753900 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:06.754208 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:06.754511 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating existing volume attachment record: f23a5d14-db2b-475b-9c4d-3950048ad6c2 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:06.978423 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999664547000066 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:06.980271 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance destroyed successfully. Jul 05 03:31:06.980942 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'numa_topology' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:07.023037 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:07.023239 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing instance network info cache due to event network-changed-066bb55b-ad03-4207-b570-25e22bfbb480. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:07.023579 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] Acquiring lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:07.023761 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] Acquired lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:07.025239 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Refreshing network info cache for port 066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:07.088783 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:31:07.088966 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:31:07.089268 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:07.089496 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:07.151209 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '073872262a6341338d468bb869b1bf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55da77bd22354fce84a6e3ff834c8d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:31:07.332382 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:07.435630 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:07.435966 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:07.436134 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:07.487343 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Attempting a stable device rescue Jul 05 03:31:07.502114 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:07.502254 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:07.502355 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:07.502452 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] No VIF found with MAC fa:16:3e:fd:e8:7f, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:07.516961 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Successfully created port: 2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:31:07.527960 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:07.537939 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 79dcf4df-1d4d-462e-9b02-4bf431533787 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:31:07.537939 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:07.537939 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Resumed (Lifecycle Event) Jul 05 03:31:07.541756 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-36959752-6b21-4eba-ac04-601ae139aee0 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:07.592092 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:31:07.635370 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:07.637038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:07.645031 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:31:07.651866 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:31:07.652061 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Creating image(s) Jul 05 03:31:07.653645 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:07.653894 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:07.654560 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:07.654841 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'trusted_certs' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:07.941535 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:08.041916 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:08.047291 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:08.095244 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:31:08.131204 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updated VIF entry in instance network info cache for port 066bb55b-ad03-4207-b570-25e22bfbb480. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:31:08.131597 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating instance_info_cache with network_info: [{"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:08.148443 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:08.157218 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:08.157529 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "c61c24331a15f92a0e21e06f5b16793e85e20267" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:08.157978 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c61c24331a15f92a0e21e06f5b16793e85e20267" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:08.317350 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Successfully updated port: 2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:31:08.348230 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Found WWN 330000000b06c9cc2 for multipath device dm-7 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:08.348564 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:08.348859 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] <== connect_volume: return (3709ms) {'type': 'block', 'scsi_wwn': '330000000b06c9cc2', 'path': '/dev/dm-7', 'multipath_id': '330000000b06c9cc2'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:08.348996 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b06c9cc2', 'path': '/dev/dm-7', 'multipath_id': '330000000b06c9cc2'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:08.349427 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.913s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:08.349526 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:08.351875 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lazy-loading 'flavor' on Instance uuid dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:08.361153 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:08.361767 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:08.362276 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:08.362544 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:08.362950 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:08.363105 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:08.374981 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:08.374981 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:08.380658 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:08.380658 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:08.386527 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:08.386907 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:08.386955 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:08.387138 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:08.393771 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:08.473421 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Unrescuing Jul 05 03:31:08.473606 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:08.473685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:08.473818 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:08.557195 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:31:08.557806 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:08.557806 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Started (Lifecycle Event) Jul 05 03:31:08.634990 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f6727ca4-ae0b-4770-a8d9-0f80364ec7b9 req-c9bbe457-6abd-4103-b701-c0f075748525 service nova] Releasing lock "refresh_cache-8925c8cc-b844-4697-9d32-99d9b39c394f" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:08.819940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:08.820141 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquired lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:08.820306 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] attach device xml: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]:
Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: Jul 05 03:31:08.855658 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:31:08.975836 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:09.008582 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.011570 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.011570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.060727 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:09.062198 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:09.073162 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a76db774-be07-4f4e-a7da-db207e57b7ed tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.532s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.085316 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.part --force-share --output=json" returned: 0 in 0.074s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.085653 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] 185efc9b-10aa-45ec-b8f9-bf2f3080c739 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:31:09.086372 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:31:09.086631 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.part /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.115598 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:31:09.115598 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:31:09.116212 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Creating image(s) Jul 05 03:31:09.118108 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "/opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:09.118305 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "/opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:09.122221 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-changed-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:09.122453 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Refreshing instance network info cache due to event network-changed-e965727e-40f0-49fd-9c81-02b644cb02a5. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:09.122680 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Acquiring lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:09.123750 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Acquired lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:09.123919 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Refreshing network info cache for port e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:09.125211 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "/opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.007s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.128733 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.133757 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.135035 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.156737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.165100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.part /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.converted" returned: 0 in 0.078s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.172701 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.218241 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.219285 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:09.219946 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:09.220453 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.223313 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.223686 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.261669 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267.converted --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.268273 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c61c24331a15f92a0e21e06f5b16793e85e20267" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.110s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.269774 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.273440 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.275178 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "c61c24331a15f92a0e21e06f5b16793e85e20267" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:09.275608 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c61c24331a15f92a0e21e06f5b16793e85e20267" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:09.275960 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.281880 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:09.281880 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267 --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.307800 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.309404 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.349579 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk 1073741824" returned: 0 in 0.040s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.350282 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.130s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.350476 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.368235 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267 --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.368958 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267,backing_fmt=raw /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.389572 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:09.395224 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:09.410436 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:09.422977 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.427396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c61c24331a15f92a0e21e06f5b16793e85e20267,backing_fmt=raw /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.rescue" returned: 0 in 0.055s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.427396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c61c24331a15f92a0e21e06f5b16793e85e20267" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.149s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.427396 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'migration_context' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:09.431915 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.444416 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.446009 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.454320 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:31:09.454954 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.456136 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:09.477883 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.482093 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.482769 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:09.514733 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:31:09.514733 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:31:09.514733 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.529168 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.548806 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:09.548806 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Cannot resize image /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:31:09.548806 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:31:09.548806 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Ensure instance console log exists: /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:31:09.549172 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:31:09.549172 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:31:09.549172 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.552113 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:09.552676 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:09.553159 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.555324 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.556119 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:09.556605 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:09.556810 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:09.559140 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:09.564375 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:09.565572 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:31:09.566817 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:09.566995 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:09.588615 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:09.590067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:09.590067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:09.590067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:09.591203 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:09.591332 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:09.611944 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:09.611944 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:09.630772 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:09.704731 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:09.752731 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Updating instance_info_cache with network_info: [{"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:09.820189 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] volume_snapshot_create: create_info: {'snapshot_id': '6fe09182-bd21-4185-9657-9b5449317d9e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=99148) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3761}} Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] snap xml: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: {{(pid=99148) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3702}} Jul 05 03:31:09.826092 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] Lazy-loading 'system_metadata' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:09.875552 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-68d1c9d7-0041-4a2b-a67c-5e3364afafc6 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] volume_snapshot_delete: delete_info: {'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf'} {{(pid=99148) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3869}} Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [None req-68d1c9d7-0041-4a2b-a67c-5e3364afafc6 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Traceback (most recent call last): Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] self._volume_snapshot_delete(context, instance, volume_id, Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] if delete_info['type'] != 'qcow2': Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] ~~~~~~~~~~~^^^^^^^^ Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] KeyError: 'type' Jul 05 03:31:09.880734 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Jul 05 03:31:09.885119 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Updating instance_info_cache with network_info: [{"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:09.927309 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:09.927504 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:31:09.928099 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start _get_guest_xml network_info=[{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:fe:62:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '185efc9b-10aa-45ec-b8f9-bf2f3080c739', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6a59cbf0-8761-4a39-9cb3-127de31d90fb', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': 'a123d3ff-9f01-46b6-838c-11bc579124ec', 'attached_at': '', 'detached_at': '', 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'serial': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:09.928238 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [None req-68d1c9d7-0041-4a2b-a67c-5e3364afafc6 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d14f3dea-b326-47cc-9276-abf2bd8002e6) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3601, in _volume_snapshot_update_status Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jul 05 03:31:09.935933 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server [None req-68d1c9d7-0041-4a2b-a67c-5e3364afafc6 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] Exception during message handling: KeyError: 'type' Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4836, in volume_snapshot_delete Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4045, in volume_snapshot_delete Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jul 05 03:31:09.951429 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server Jul 05 03:31:10.062164 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:10.205115 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updated VIF entry in instance network info cache for port e965727e-40f0-49fd-9c81-02b644cb02a5. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:31:10.205524 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updating instance_info_cache with network_info: [{"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:10.255112 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-79dcf4df-1d4d-462e-9b02-4bf431533787" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:10.255705 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'flavor' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:10.291580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:10.291836 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:10.292090 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Attaching volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc to /dev/vdb Jul 05 03:31:10.329579 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Traceback (most recent call last): Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.336306 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Traceback (most recent call last): Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] self._volume_snapshot_create(context, instance, guest, Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.339893 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [instance: d5282468-599f-4af3-b640-af72408dd7d6] Jul 05 03:31:10.356074 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6fe09182-bd21-4185-9657-9b5449317d9e could not be found. Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6fe09182-bd21-4185-9657-9b5449317d9e could not be found. (HTTP 404) (Request-ID: req-bb501902-19df-48ce-aec7-faeb0b66ece8) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3601, in _volume_snapshot_update_status Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6fe09182-bd21-4185-9657-9b5449317d9e could not be found. Jul 05 03:31:10.362641 np0000004562 nova-compute[99148]: ERROR nova.virt.libvirt.driver Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server [None req-30338baf-bd73-45a7-8aba-12183cd020b8 tempest-VolumesAssistedSnapshotsTest-1158055660 tempest-VolumesAssistedSnapshotsTest-1158055660-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4824, in volume_snapshot_create Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3782, in volume_snapshot_create Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 05 03:31:10.366172 np0000004562 nova-compute[99148]: ERROR oslo_messaging.rpc.server Jul 05 03:31:10.367650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:10.367963 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:10.386858 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:10.396313 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Releasing lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:10.397207 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Instance network_info: |[{"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:31:10.399675 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Start _get_guest_xml network_info=[{"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:10.403301 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:10.405169 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-622792618', uuid='229ef5ac-5766-4a82-98f2-3c6e6d44cda1'), owner=OwnerMeta(userid='073872262a6341338d468bb869b1bf02', username='tempest-ServersNegativeTestJSON-789470158-project-member', projectid='55da77bd22354fce84a6e3ff834c8d0f', projectname='tempest-ServersNegativeTestJSON-789470158'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222270.4046266) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:10.406209 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:10.406665 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:10.407432 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:10.407618 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:10.408798 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:10.409259 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:10.409435 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:10.409564 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:10.409728 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:10.409831 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:10.409926 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:10.410131 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:10.410242 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:10.410379 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:10.410501 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:10.410631 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:10.418100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:10.419186 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:10.423660 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-622792618',display_name='tempest-ServersNegativeTestJSON-server-622792618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-622792618',id=13,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-nnjxown9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:08Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=229ef5ac-5766-4a82-98f2-3c6e6d44cda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:10.423907 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:10.424645 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:10.425283 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lazy-loading 'pci_devices' on Instance uuid 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:10.427347 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:10.429161 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe0f:deb4', 'fe80::6c08:9bff:fe0f:3c4a', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be'] Jul 05 03:31:10.429304 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:10.429601 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:10.429648 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:10.429857 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating existing volume attachment record: dd5116fe-46da-4815-a9ad-6f42cd6c1559 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:10.431688 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:10.435981 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:10.436983 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095', uuid='a123d3ff-9f01-46b6-838c-11bc579124ec'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:fe:62:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222270.43668) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:10.438765 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:10.439133 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:10.444091 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:10.444260 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:10.444976 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:10.445250 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:10.445356 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:10.445467 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:10.445612 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:10.445612 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:10.445726 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:10.445849 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:10.445944 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:10.446057 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:10.446145 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:10.446240 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:10.446353 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'vcpu_model' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:10.552341 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No BDM found with device name sda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:10.552513 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No BDM found with device name sdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:10.552569 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No BDM found with device name sdc, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:10.552731 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] No VIF found with MAC fa:16:3e:0f:de:b4, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:10.580207 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:10.580830 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:10.707649 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Releasing lock "refresh_cache-a5af3d1a-6bd5-427a-90fd-2a464878e157" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:10.707836 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-changed-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:10.707963 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Refreshing instance network info cache due to event network-changed-2e29c628-f58c-4781-b8af-4c9b5a938848. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:10.708213 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Acquiring lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:10.708311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Acquired lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:10.708467 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Refreshing network info cache for port 2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:10.765830 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.776305 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] End _get_guest_xml xml= Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: instance-0000000d Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 196608 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-server-622792618 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 2026-07-05 03:31:10 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 192 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: True Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: bare Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-789470158-project-member Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: tempest-ServersNegativeTestJSON-789470158 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: Jul 05 03:31:10.928224 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Preparing to wait for external event network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-622792618',display_name='tempest-ServersNegativeTestJSON-server-622792618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-622792618',id=13,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-nnjxown9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:08Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=229ef5ac-5766-4a82-98f2-3c6e6d44cda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:10.931481 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:31:10.932266 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.932487 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a097e0e8-1f18-5511-baf7-60d9cbdbd1f7', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:10.933501 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.934649 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:10.937107 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.937313 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e29c628-f5, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:10.937727 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e29c628-f5, col_values=(('qos', UUID('1988d05b-5c74-4e12-a1e9-ad6fcea50d5d')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:10.937932 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e29c628-f5, col_values=(('external_ids', {'iface-id': '2e29c628-f58c-4781-b8af-4c9b5a938848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:2f:71', 'vm-uuid': '229ef5ac-5766-4a82-98f2-3c6e6d44cda1'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:10.939962 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.941529 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:10.945473 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.949970 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:10.958600 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.961324 np0000004562 nova-compute[99148]: INFO os_vif [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') Jul 05 03:31:10.965880 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:10.982385 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:10.987937 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:11.005351 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:11.005351 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:11.005351 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:11.043186 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:11.043619 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:11.043860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:11.044464 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:11.044855 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:11.045190 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:11.045327 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:11.081613 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999723958000004 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:11.083301 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Detaching volume 437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:11.085541 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance destroyed successfully. Jul 05 03:31:11.085979 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'numa_topology' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:11.106332 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:11.109591 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:11.128313 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Attempting to driver detach volume 437e95a7-c3d5-428d-9a9d-dd15b3f10caf from mountpoint /dev/vdb Jul 05 03:31:11.132691 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Found disk vdb by alias ua-437e95a7-c3d5-428d-9a9d-dd15b3f10caf {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:11.133762 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Found disk vdb by alias ua-437e95a7-c3d5-428d-9a9d-dd15b3f10caf {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:11.133929 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Attempting to detach device vdb from instance d5282468-599f-4af3-b640-af72408dd7d6 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] detach device xml: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: 437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]:
Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: Jul 05 03:31:11.134264 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:11.140536 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Successfully detached device vdb from instance d5282468-599f-4af3-b640-af72408dd7d6 from the persistent domain config. Jul 05 03:31:11.140820 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] (1/8): Attempting to detach device vdb with device alias ua-437e95a7-c3d5-428d-9a9d-dd15b3f10caf from instance d5282468-599f-4af3-b640-af72408dd7d6 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] detach device xml: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: 437e95a7-c3d5-428d-9a9d-dd15b3f10caf Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]:
Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: Jul 05 03:31:11.141155 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:11.153951 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7079467c-a927-4fa4-b085-4588c2732f4d req-cad81823-27a4-488a-a8fe-6cab8f464f6b service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:11.154156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7079467c-a927-4fa4-b085-4588c2732f4d req-cad81823-27a4-488a-a8fe-6cab8f464f6b service nova] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:11.154295 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7079467c-a927-4fa4-b085-4588c2732f4d req-cad81823-27a4-488a-a8fe-6cab8f464f6b service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:11.154474 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7079467c-a927-4fa4-b085-4588c2732f4d req-cad81823-27a4-488a-a8fe-6cab8f464f6b service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:11.154542 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7079467c-a927-4fa4-b085-4588c2732f4d req-cad81823-27a4-488a-a8fe-6cab8f464f6b service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Processing event network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:31:11.211028 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:11.304509 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:11.384037 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Found WWN 3300000008471b24d for multipath device dm-8 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:11.384356 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:11.384497 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== connect_volume: return (3948ms) {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-8', 'multipath_id': '3300000008471b24d'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:11.384646 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-8', 'multipath_id': '3300000008471b24d'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:11.385362 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.380s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:11.385362 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:11.393212 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'flavor' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:11.395079 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:11.395901 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:11.396084 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:11.396639 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:11.397963 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:11.397963 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:11.410737 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:11.410737 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:11.415779 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:11.415779 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc] added Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:11.422248 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:11.422484 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:11.422578 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:11.422729 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc] added Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:11.428680 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:11.428903 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:11.429081 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:11.429212 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:11.529586 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:11.588052 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<79dcf4df-1d4d-462e-9b02-4bf431533787> lazy-loaded attributes: flavor,numa_topology {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:11.643544 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-437e95a7-c3d5-428d-9a9d-dd15b3f10caf> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:31:11.645405 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-437e95a7-c3d5-428d-9a9d-dd15b3f10caf for instance d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:31:11.647838 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Successfully detached device vdb from instance d5282468-599f-4af3-b640-af72408dd7d6 from the live domain config. Jul 05 03:31:11.648807 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:11.649165 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:11.649338 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:11.676441 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Updated VIF entry in instance network info cache for port 2e29c628-f58c-4781-b8af-4c9b5a938848. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:31:11.676773 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Updating instance_info_cache with network_info: [{"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:11.898847 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attempting to attach volume 63ed7b16-387c-4938-9d2e-0f4c344e1ee2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] attach device xml: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: 63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: Jul 05 03:31:11.899940 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:31:12.120740 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6801bea3-c8da-4056-ba2e-b5574da4dad9 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.154s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:12.178608 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8666726a-4b14-454b-9fb7-c96d0a0cb47a req-0cdeddea-c023-4565-95fc-7a79c7bb8106 service nova] Releasing lock "refresh_cache-229ef5ac-5766-4a82-98f2-3c6e6d44cda1" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:12.234949 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:12.237278 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:12.423608 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:12.431090 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:12.437976 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:12.447420 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.455856 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.462218 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.482812 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.483343 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.490046 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.490676 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:12.491170 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:12.491329 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:12.491478 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] No VIF found with MAC fa:16:3e:d8:2f:71, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:12.492105 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Using config drive Jul 05 03:31:12.550754 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.40.100,3260] Jul 05 03:31:12.550754 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.40.100,3260] successful. Jul 05 03:31:12.550754 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.558754 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.50.100,3260] Jul 05 03:31:12.558754 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.50.100,3260] successful. Jul 05 03:31:12.558754 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.568788 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.574838 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.589724 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:12.594852 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:12.597150 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] HCTL ('21', '-', '-', 0) found on session 19 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:12.597150 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:12.600757 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:12.602779 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] HCTL ('22', '-', '-', 0) found on session 20 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:12.602937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:12.617529 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching for a device in session 19 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:12.618154 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:12.624145 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:12.624346 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:12.997207 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:13.078198 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 79dcf4df-1d4d-462e-9b02-4bf431533787 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:31:13.078349 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:13.078511 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Resumed (Lifecycle Event) Jul 05 03:31:13.083347 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-6d561880-077b-4154-9c69-b8d0ea8d9216 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:13.139348 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Creating config drive at /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.config Jul 05 03:31:13.144339 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbe2ctqsn {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:13.184577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbe2ctqsn" returned: 0 in 0.040s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:13.191199 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:13.191455 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] No waiting events found dispatching network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:13.226189 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-c82e4c1d-e707-42c9-bfa9-d8eb08bc0131 req-8e007bb4-330e-45c1-8dbe-c42520cc9b3b service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received unexpected event network-vif-plugged-2e29c628-f58c-4781-b8af-4c9b5a938848 for instance with vm_state building and task_state spawning. Jul 05 03:31:13.398262 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:13.582632 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:13.584586 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:13.617171 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:13.630003 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:13.635184 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:13.635405 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:13.635549 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:13.636214 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No VIF found with MAC fa:16:3e:0f:da:ea, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:13.694432 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Detaching volume aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:13.741271 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Attempting to driver detach volume aaa93144-80be-4be9-aa5d-81289064b5bb from mountpoint /dev/sdc Jul 05 03:31:13.751372 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Found disk sdc by alias ua-aaa93144-80be-4be9-aa5d-81289064b5bb {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:13.753217 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Found disk sdc by alias ua-aaa93144-80be-4be9-aa5d-81289064b5bb {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:13.753443 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Attempting to detach device sdc from instance dceabcd9-3341-412c-8492-121a739b626d from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] detach device xml: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]:
Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: Jul 05 03:31:13.753988 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:13.759682 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Successfully detached device sdc from instance dceabcd9-3341-412c-8492-121a739b626d from the persistent domain config. Jul 05 03:31:13.759879 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] (1/8): Attempting to detach device sdc with device alias ua-aaa93144-80be-4be9-aa5d-81289064b5bb from instance dceabcd9-3341-412c-8492-121a739b626d from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] detach device xml: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: aaa93144-80be-4be9-aa5d-81289064b5bb Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]:
Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: Jul 05 03:31:13.760116 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:13.934046 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-aaa93144-80be-4be9-aa5d-81289064b5bb for instance dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:31:14.088356 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:14.088494 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Started (Lifecycle Event) Jul 05 03:31:14.416694 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:31:14.417009 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found WWN 3300000005bdd2706 for multipath device dm-9 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:14.417369 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:14.417728 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] <== connect_volume: return (3412ms) {'type': 'block', 'scsi_wwn': '3300000005bdd2706', 'path': '/dev/dm-9', 'multipath_id': '3300000005bdd2706'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:14.417877 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005bdd2706', 'path': '/dev/dm-9', 'multipath_id': '3300000005bdd2706'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:14.418326 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.373s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:14.418612 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:14.421173 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:31:14.422325 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:14.424490 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Instance spawned successfully. Jul 05 03:31:14.424910 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:31:14.430160 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:14.430601 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:14.430820 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:14.431255 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:14.431929 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:14.432197 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:14.445682 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:14.454767 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:14.460362 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:14.473828 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.484736 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:14.486045 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:14.486045 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:14.486234 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('13', '0', '0', 0) found on session 11 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:14.486234 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:14.494509 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 11 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:14.494845 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.495304 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:14.495787 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:14.496648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('14', '0', '0', 0) found on session 12 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:14.496648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:14.505707 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 12 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:14.505861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:14.593679 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:14.595306 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:14.927276 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Attempting to attach volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] attach device xml: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: Jul 05 03:31:14.928073 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:31:14.935953 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:14.936128 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:14.936379 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:14.936593 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:14.936941 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:14.937277 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:15.097995 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-aaa93144-80be-4be9-aa5d-81289064b5bb> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:31:15.098257 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:15.098329 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] VM Started (Lifecycle Event) Jul 05 03:31:15.106618 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Successfully detached device sdc from instance dceabcd9-3341-412c-8492-121a739b626d from the live domain config. Jul 05 03:31:15.106618 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:15.106618 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:15.106618 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:15.189135 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f9f1222e-a401-4706-8315-e343b76d0e16 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.582s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:15.434078 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:15.442669 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Took 6.33 seconds to spawn the instance on the hypervisor. Jul 05 03:31:15.442897 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:15.602236 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:15.606632 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:15.939899 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:15.952919 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Took 12.11 seconds to build instance. Jul 05 03:31:16.023148 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:16.108941 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:16.109112 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] VM Paused (Lifecycle Event) Jul 05 03:31:16.308088 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:16.453290 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Found WWN 330000000e226bb4b for multipath device dm-5 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:16.453552 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:16.453799 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== connect_volume: return (5408ms) {'type': 'block', 'scsi_wwn': '330000000e226bb4b', 'path': '/dev/dm-5', 'multipath_id': '330000000e226bb4b'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:16.453888 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e226bb4b', 'path': '/dev/dm-5', 'multipath_id': '330000000e226bb4b'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:16.454500 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.805s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:16.454903 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:16.455379 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3d110e0e-e9fb-4844-80e6-a32df58c699b tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.620s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:16.455582 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.497725 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:16.498610 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', '13')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:16.500991 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf', '14')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:16.501737 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Resulting device map defaultdict(. at 0x7249b43214e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'): ({'sdk'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:16.502125 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Removing multipathed devices sdk, sdj {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:16.502746 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Flush multipath device 330000000c24ab7be {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:16.544429 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:16.593626 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:16.594049 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:16.594167 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:16.594571 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No VIF found with MAC fa:16:3e:1e:a5:59, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:16.603744 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:16.612053 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:16.613249 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:16.613682 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] VM Resumed (Lifecycle Event) Jul 05 03:31:16.662298 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:16.662509 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:16.671891 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:16.687560 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:16.688486 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:16.706750 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.764280 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.40.100,3260] Jul 05 03:31:16.764280 np0000004562 nova-compute[99148]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.40.100,3260] successful. Jul 05 03:31:16.764280 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.805307 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.819954 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.862959 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.50.100,3260] Jul 05 03:31:16.862959 np0000004562 nova-compute[99148]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-437e95a7-c3d5-428d-9a9d-dd15b3f10caf, portal: 192.168.50.100,3260] successful. Jul 05 03:31:16.862959 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.888056 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:16.888056 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:16.888208 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] <== disconnect_volume: return (5238ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:16.888662 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:16.890579 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.785s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:16.891775 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aaa93144-80be-4be9-aa5d-81289064b5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:16.891775 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.930803 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:16.931364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '15')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:16.933495 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb', '16')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:16.934056 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Resulting device map defaultdict(. at 0x7249ac6cf060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'): ({'sdm'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:16.934617 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Removing multipathed devices sdm, sdl {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:16.934617 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Flush multipath device 330000000b06c9cc2 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:16.964645 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-709522095',id=11,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:01Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-5s8ksnqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:01Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=a123d3ff-9f01-46b6-838c-11bc579124ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:fe:62:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:16.964645 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:fe:62:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:16.964645 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:16.965639 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:16.976055 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:17.026611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:17.078375 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:17.078533 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:17.079973 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:17.090320 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:17.090482 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:17.106196 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.119231 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:17.122098 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:17.147073 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.40.100,3260] Jul 05 03:31:17.147073 np0000004562 nova-compute[99148]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.40.100,3260] successful. Jul 05 03:31:17.147073 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.167192 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.171268 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:17.171479 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:17.171691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:17.171864 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:17.171983 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:17.174136 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Terminating instance Jul 05 03:31:17.178383 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.219939 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.50.100,3260] Jul 05 03:31:17.219939 np0000004562 nova-compute[99148]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-aaa93144-80be-4be9-aa5d-81289064b5bb, portal: 192.168.50.100,3260] successful. Jul 05 03:31:17.219939 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.248067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:17.248362 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:17.248950 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] <== disconnect_volume: return (2143ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:17.249114 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:17.454701 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lazy-loading 'flavor' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] End _get_guest_xml xml= Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: instance-0000000b Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 196608 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-709522095 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 2026-07-05 03:31:10 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 192 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: True Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: bare Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: ide Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: pc Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: 9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: Jul 05 03:31:17.470244 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:17.475370 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance destroyed successfully. Jul 05 03:31:17.626085 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] During sync_power_state the instance has a pending task (deleting). Skip. Jul 05 03:31:17.677298 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:17.683528 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:17.696884 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:17.807227 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lazy-loading 'flavor' on Instance uuid dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:18.004771 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999644689999968 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:18.006392 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Instance destroyed successfully. Jul 05 03:31:18.006680 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lazy-loading 'resources' on Instance uuid 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:18.153568 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7ad5c0e4-ca43-4a4e-b379-9465c42155ad tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.862s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:18.164503 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:18.164768 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:18.384882 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Stashing vm_state: active {{(pid=99148) _prep_resize /opt/stack/nova/nova/compute/manager.py:6345}} Jul 05 03:31:18.462423 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6cbce34-26c9-4463-9a75-049939931233 tempest-VolumesAssistedSnapshotsTest-169104100 tempest-VolumesAssistedSnapshotsTest-169104100-project-admin] Lock "d5282468-599f-4af3-b640-af72408dd7d6" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 7.882s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:18.509028 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-622792618',display_name='tempest-ServersNegativeTestJSON-server-622792618',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-622792618',id=13,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:15Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-nnjxown9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:15Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=229ef5ac-5766-4a82-98f2-3c6e6d44cda1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:18.509259 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "2e29c628-f58c-4781-b8af-4c9b5a938848", "address": "fa:16:3e:d8:2f:71", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e29c628-f5", "ovs_interfaceid": "2e29c628-f58c-4781-b8af-4c9b5a938848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:18.510980 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:18.511376 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:18.538014 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.549102 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.551962 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.552307 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e29c628-f5, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:18.555489 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.556656 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:18.564371 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.566325 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.566325 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1988d05b-5c74-4e12-a1e9-ad6fcea50d5d) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:18.570065 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.571160 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:18.574049 np0000004562 nova-compute[99148]: INFO os_vif [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:2f:71,bridge_name='br-int',has_traffic_filtering=True,id=2e29c628-f58c-4781-b8af-4c9b5a938848,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e29c628-f5') Jul 05 03:31:18.575007 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Deleting instance files /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1_del Jul 05 03:31:18.576355 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Deletion of /opt/stack/data/nova/instances/229ef5ac-5766-4a82-98f2-3c6e6d44cda1_del complete Jul 05 03:31:18.589927 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00040008699988902663 future=) was cancelled during its delay period, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:18.590036 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:18.590183 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.3878733700000794 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:18.590253 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.387767072000088 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:18.667631 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:31:18.716833 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:18.717035 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:18.732683 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.734774 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:18.780223 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:18.780623 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:18.780816 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:18.780948 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:18.781097 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] No waiting events found dispatching network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:18.781224 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8c535091-3154-4795-8fc9-c32c4d09f93b req-468c246c-82a0-4e6d-a1c8-070fda36cf09 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:18.812665 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6b639020-39fd-4768-af4b-974cab004d87 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.621s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:18.934335 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:18.934521 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:18.990299 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:18.990432 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:18.990515 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:18.990603 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:fe:62:be, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:18.991047 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Using config drive Jul 05 03:31:19.081856 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Took 1.40 seconds to destroy the instance on the hypervisor. Jul 05 03:31:19.082597 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:19.082786 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:19.082900 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:19.083169 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:19.153021 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:19.220744 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:19.242375 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:19.430605 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1e461652-b917-42d8-a153-fba54f85fe92 req-90de7673-dde4-4e9f-8ac4-5a3adb485874 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-deleted-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:19.431977 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-1e461652-b917-42d8-a153-fba54f85fe92 req-90de7673-dde4-4e9f-8ac4-5a3adb485874 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Neutron deleted interface 2e29c628-f58c-4781-b8af-4c9b5a938848; detaching it from the instance and deleting it from the info cache Jul 05 03:31:19.433469 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1e461652-b917-42d8-a153-fba54f85fe92 req-90de7673-dde4-4e9f-8ac4-5a3adb485874 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Detach interface failed, port_id=2e29c628-f58c-4781-b8af-4c9b5a938848, reason: Instance 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:19.440730 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:19.440730 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Claim successful on node np0000004562 Jul 05 03:31:19.493521 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'ec2_ids' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:19.770814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:19.770814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:19.770814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:19.770814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:19.770814 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:19.772280 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Terminating instance Jul 05 03:31:19.889337 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:19.946404 np0000004562 nova-compute[99148]: INFO nova.compute.resource_tracker [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating resource usage from migration d0ca6070-b19e-44f8-b95a-66f3ab384f84 Jul 05 03:31:19.999732 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:19.999732 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'keypairs' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:20.225295 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.508s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:20.277107 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:20.281980 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:20.294671 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:20.391254 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Took 1.31 seconds to deallocate network for instance. Jul 05 03:31:20.452357 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:20.452510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:20.452651 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:20.452802 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:20.452897 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:20.454730 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Terminating instance Jul 05 03:31:20.499238 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:20.503122 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:20.621191 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999692859000106 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:20.626437 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] Instance destroyed successfully. Jul 05 03:31:20.627428 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lazy-loading 'resources' on Instance uuid dceabcd9-3341-412c-8492-121a739b626d {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:20.669736 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:20.670886 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:20.701574 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Creating config drive at /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config.rescue Jul 05 03:31:20.705113 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcz2r45jk {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:20.744809 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcz2r45jk" returned: 0 in 0.039s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:20.875532 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received event network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:20.878391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] Acquiring lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:20.878391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:20.878391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:20.878391 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] No waiting events found dispatching network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:20.878391 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-176eb3e2-b60f-4a3b-abd8-4f6995032491 req-8942f5d2-88b2-431b-b9c4-5ad0f8f5efe9 service nova] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Received unexpected event network-vif-unplugged-2e29c628-f58c-4781-b8af-4c9b5a938848 for instance with vm_state deleted and task_state None. Jul 05 03:31:20.897321 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:20.958071 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:20.965550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:20.979927 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.136855 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-19656028',display_name='tempest-AttachSCSIVolumeTestJSON-server-19656028',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachscsivolumetestjson-server-19656028',id=5,image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+3DS82fY0U/rThb6pQQ6j1XS2utJatvWGcTk1MuWQ5LomKYQk4vSWjdhd172XpTzt742XVHkH8JABmelxFGIMyDIEg4c9dlJKtk+55017FeTkD2o9GuC/UnZ3J7BEGQ==',key_name='tempest-keypair-2137131373',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:21Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8f15da77ec4e4a65bcdd563097de4c3b',ramdisk_id='',reservation_id='r-l2mg5068',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3a097e0f-2e03-4087-b194-550e03175ca1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-594600634',owner_user_name='tempest-AttachSCSIVolumeTestJSON-594600634-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc9d8d23e4a43009ede6e0b2291c365',uuid=dceabcd9-3341-412c-8492-121a739b626d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:21.136855 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converting VIF {"id": "0783e26a-b86f-4c47-9d34-e5257070756f", "address": "fa:16:3e:0f:de:b4", "network": {"id": "cf11972d-9546-4a3e-9d17-3db80ebfb90d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1453960503-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f15da77ec4e4a65bcdd563097de4c3b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783e26a-b8", "ovs_interfaceid": "0783e26a-b86f-4c47-9d34-e5257070756f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:21.136855 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:21.136855 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:21.158445 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.162519 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.174879 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:21.179442 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.183621 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0783e26a-b8, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:21.185019 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.185663 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:21.210367 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.216708 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.219333 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.219521 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1cc0ee3-4d5c-496b-951d-826c4d61321d) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:21.220307 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.220970 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:21.222352 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.226559 np0000004562 nova-compute[99148]: INFO os_vif [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:de:b4,bridge_name='br-int',has_traffic_filtering=True,id=0783e26a-b86f-4c47-9d34-e5257070756f,network=Network(cf11972d-9546-4a3e-9d17-3db80ebfb90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783e26a-b8') Jul 05 03:31:21.230297 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Deleting instance files /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d_del Jul 05 03:31:21.230297 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Deletion of /opt/stack/data/nova/instances/dceabcd9-3341-412c-8492-121a739b626d_del complete Jul 05 03:31:21.308701 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.318837 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:21.318837 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:21.319014 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Attaching volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc to /dev/vdb Jul 05 03:31:21.324575 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:21.326330 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:21.326650 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:21.326860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:21.327076 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] No waiting events found dispatching network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:21.327276 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-916acff5-6c51-47ec-89bc-db68280980ea req-1e76fdf9-3798-4e8f-a368-b7c48670b431 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:21.387127 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999564961000033 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.389381 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:21.392515 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Instance destroyed successfully. Jul 05 03:31:21.392908 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lazy-loading 'resources' on Instance uuid d5282468-599f-4af3-b640-af72408dd7d6 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:21.402589 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:21.428359 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:21.461594 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:21.462288 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:21.468747 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:21.470298 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::f816:3eff:fefd:e87f', 'fe80::f81f:6fff:fe58:32e3', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be'] Jul 05 03:31:21.470625 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:21.470836 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:21.471307 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:21.471788 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updating existing volume attachment record: 20b4dd52-81f6-401d-ba77-e52da90bd8d3 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:21.689430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.755s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:21.689879 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.448s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:21.690091 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Migrating Jul 05 03:31:21.690311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:21.690422 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "compute-rpcapi-router" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:21.696334 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:21.696646 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Claim successful on node np0000004562 Jul 05 03:31:21.737462 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Took 1.46 seconds to destroy the instance on the hypervisor. Jul 05 03:31:21.742236 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:21.742391 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:21.742772 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:21.743184 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:21.842328 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:21.900159 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-627436530',display_name='tempest-VolumesAssistedSnapshotsTest-server-627436530',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesassistedsnapshotstest-server-627436530',id=4,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7OoV2DIPcCWbVfrzoMxevD7ldzcybircMn/uLCiAkAM10v93ROCeRf3XZraDd03T/5uVN+hnNvrj27sTDMje3XCA0IqNUvb9cnIGQMZgdEDPayx9sZHcZ+6Lj+jH6bGg==',key_name='tempest-keypair-1780835719',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:20Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='18996417885c4ff8b2c6ec2fa2563e43',ramdisk_id='',reservation_id='r-lznorq0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-632308792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-632308792-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdc3b878cf1442c3bdb97246e4cfa3f7',uuid=d5282468-599f-4af3-b640-af72408dd7d6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:21.900438 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converting VIF {"id": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "address": "fa:16:3e:fd:e8:7f", "network": {"id": "3eb1d84f-e823-4e5a-b834-87d2edf3ee7f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-238785274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18996417885c4ff8b2c6ec2fa2563e43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap916d9fcb-aa", "ovs_interfaceid": "916d9fcb-aaf2-43c0-afeb-c4d5111c84eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:21.901159 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:21.901416 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:21.931283 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.934894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.935071 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap916d9fcb-aa, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:21.938045 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.940339 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:21.958003 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.959292 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.959459 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35d253b3-7c69-4669-b864-e7320a66d176) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:21.960760 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.960760 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:21.961239 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.964191 np0000004562 nova-compute[99148]: INFO os_vif [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e8:7f,bridge_name='br-int',has_traffic_filtering=True,id=916d9fcb-aaf2-43c0-afeb-c4d5111c84eb,network=Network(3eb1d84f-e823-4e5a-b834-87d2edf3ee7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap916d9fcb-aa') Jul 05 03:31:21.964611 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Deleting instance files /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6_del Jul 05 03:31:21.966205 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Deletion of /opt/stack/data/nova/instances/d5282468-599f-4af3-b640-af72408dd7d6_del complete Jul 05 03:31:21.978642 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00041228500003853696 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.978642 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.978897 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.102403267 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.979355 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:21.979518 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Stopped (Lifecycle Event) Jul 05 03:31:21.982098 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=4.099597253999946 future=) was cancelled while queued, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.982098 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.982098 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.0224060380001 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.982098 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.022278861000132 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:21.983281 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:21.986105 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:22.044138 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:22.044494 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:22.044627 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:22.044998 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:22.045204 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:22.058087 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:22.058474 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:22.058651 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:22.059903 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:22.060393 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:22.060586 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:22.072291 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:22.078606 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:22.086054 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:22.094526 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.109442 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.109859 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:22.110102 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:22.110102 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:22.110904 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] HCTL ('21', '0', '0', 0) found on session 19 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:22.111051 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:22.119294 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching for a device in session 19 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:22.119754 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.120201 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:22.120697 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:22.121106 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:22.121106 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:22.121723 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] HCTL ('22', '0', '0', 0) found on session 20 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:22.121920 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:22.129839 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Searching for a device in session 20 and hctl ('22', '0', '0', 0) yield: sdq {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:22.130005 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:22.199563 np0000004562 nova-compute[99148]: INFO nova.compute.rpcapi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jul 05 03:31:22.200205 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "compute-rpcapi-router" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:22.200443 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:31:22.212907 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for a123d3ff-9f01-46b6-838c-11bc579124ec due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:31:22.214733 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:22.218665 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Resumed (Lifecycle Event) Jul 05 03:31:22.244316 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-cccd10d6-3676-40c0-a731-11291a3728e7 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:22.472824 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Took 1.51 seconds to destroy the instance on the hypervisor. Jul 05 03:31:22.473409 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:22.473884 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:22.474143 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:22.474831 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:22.483178 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee55b5b6-db27-43a6-a473-a9b0265f60b3 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:22.637147 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:22.731098 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:22.731258 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:22.731367 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:22.742428 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:22.752869 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:23.008621 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cab155d0-5207-4e97-a03a-86f9fcf80658 req-3e8329d9-a959-46ff-a9c0-61a90d4c3652 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-deleted-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:23.008807 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-cab155d0-5207-4e97-a03a-86f9fcf80658 req-3e8329d9-a959-46ff-a9c0-61a90d4c3652 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Neutron deleted interface 0783e26a-b86f-4c47-9d34-e5257070756f; detaching it from the instance and deleting it from the info cache Jul 05 03:31:23.010313 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cab155d0-5207-4e97-a03a-86f9fcf80658 req-3e8329d9-a959-46ff-a9c0-61a90d4c3652 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Detach interface failed, port_id=0783e26a-b86f-4c47-9d34-e5257070756f, reason: Instance dceabcd9-3341-412c-8492-121a739b626d could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:23.060972 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:31:23.233496 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:23.260333 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:23.260733 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Started (Lifecycle Event) Jul 05 03:31:23.420555 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:23.421823 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Acquiring lock "dceabcd9-3341-412c-8492-121a739b626d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:23.421991 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:23.422301 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "dceabcd9-3341-412c-8492-121a739b626d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:23.422301 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] No waiting events found dispatching network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: dceabcd9-3341-412c-8492-121a739b626d] Received event network-vif-unplugged-0783e26a-b86f-4c47-9d34-e5257070756f for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] No waiting events found dispatching network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Acquiring lock "d5282468-599f-4af3-b640-af72408dd7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] Lock "d5282468-599f-4af3-b640-af72408dd7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] No waiting events found dispatching network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:23.424744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-660620a9-cbf4-4360-8790-2da5dbc58c26 req-3e5a68cb-3b0c-4b90-a5fc-7b7b128806a0 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-unplugged-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:23.446112 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:23.626455 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:23.626674 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:23.651244 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:23.766092 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:23.767891 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:23.817887 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:23.874797 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Unrescuing Jul 05 03:31:23.875196 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:23.876031 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:23.876184 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:23.876259 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:23.948078 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: dceabcd9-3341-412c-8492-121a739b626d] Took 2.21 seconds to deallocate network for instance. Jul 05 03:31:24.075029 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found WWN 3300000005bdd2706 for multipath device dm-9 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:24.075245 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:24.075374 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] <== connect_volume: return (2030ms) {'type': 'block', 'scsi_wwn': '3300000005bdd2706', 'path': '/dev/dm-9', 'multipath_id': '3300000005bdd2706'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:24.075480 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005bdd2706', 'path': '/dev/dm-9', 'multipath_id': '3300000005bdd2706'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:24.077142 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:24.130038 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:24.270693 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:31:24.319690 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:24.378238 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:24.380334 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Took 1.91 seconds to deallocate network for instance. Jul 05 03:31:24.456382 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:24.579824 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Attempting to attach volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] attach device xml: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: Jul 05 03:31:24.580680 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:31:24.635892 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.946s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:24.636583 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.739s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:24.636756 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:31:24.696346 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:24.879223 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating instance_info_cache with network_info: [{"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:24.886610 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:25.145204 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:31:25.145514 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:31:25.145637 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:25.145870 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:25.223473 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76127ae0b2ae45ff8d4cd7430fc67ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31f3215e6204f19859b8f62235b8cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:31:25.381336 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-a123d3ff-9f01-46b6-838c-11bc579124ec" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:25.381864 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'flavor' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:25.416700 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:25.416970 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:25.502446 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5273db9a-f747-4daa-ac03-67bed6555f37 req-0045d7e8-6d14-482f-88cd-e8dca3b4fa27 service nova] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Received event network-vif-deleted-916d9fcb-aaf2-43c0-afeb-c4d5111c84eb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:25.648004 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:31:25.746048 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Successfully created port: ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:31:25.838721 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Starting migrate_disk_and_power_off {{(pid=99148) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12672}} Jul 05 03:31:25.845549 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:25.857178 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:25.895523 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:25.905586 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:25.921605 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:26.152168 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:31:26.249169 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999722595000094 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:26.250935 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance destroyed successfully. Jul 05 03:31:26.251855 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:23Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:26.252055 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:26.252559 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:26.252867 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:26.255594 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:26.256064 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:26.256064 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:26.257507 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] No VIF found with MAC fa:16:3e:2f:70:b2, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:26.265610 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Successfully updated port: ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:31:26.268168 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999694112000043 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:26.269604 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance destroyed successfully. Jul 05 03:31:26.273101 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'numa_topology' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:26.295925 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.299961 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.300603 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c91f432-9a, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:26.301568 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.302476 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:26.326073 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.335906 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.336108 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5485eaf2-2d9d-4c3a-9121-9d92d2386153) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:26.336639 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.337143 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:26.347794 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:26.348233 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing instance network info cache due to event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:26.348396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:26.349471 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:26.349471 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:26.349629 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.357350 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:26.360554 np0000004562 nova-compute[99148]: INFO os_vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:31:26.362600 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:26.362939 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:26.363485 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:26.364057 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:26.364469 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:26.364632 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:26.397246 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:26.398020 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '17')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:26.400447 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '18')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:26.400622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Resulting device map defaultdict(. at 0x7249ac6a6ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdo'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:26.400888 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Removing multipathed devices sdn, sdo {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:26.401182 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flush multipath device 3300000008471b24d {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:26.429008 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.793s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:26.431235 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.973s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:26.435737 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:26.502239 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:26.502873 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:26.503129 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:26.503300 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:26.503625 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:26.503724 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1571ca37-3626-438c-8ef2-db75e8e059ba req-17c88279-cc66-415c-989f-ac8cd9b96237 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state active and task_state resize_migrating. Jul 05 03:31:26.504966 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:26.520027 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Deleted allocations for instance 229ef5ac-5766-4a82-98f2-3c6e6d44cda1 Jul 05 03:31:26.556352 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:26.556595 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:26.558140 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:26.569905 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:26.570429 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:26.584821 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.627723 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:31:26.627723 np0000004562 nova-compute[99148]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:31:26.627723 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.647319 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.662551 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.702341 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:31:26.702341 np0000004562 nova-compute[99148]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:31:26.702341 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.721598 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:26.721945 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:26.722108 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== disconnect_volume: return (358ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:26.722245 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:26.726012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:26.770611 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:26.775347 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:26.814105 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:26.814105 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:26.853389 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:26.889104 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:26.889444 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:31:26.890094 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:26.949698 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:26.962425 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk" returned: 0 in 0.072s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:26.962934 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk.config /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:26.991657 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk.config /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config" returned: 0 in 0.028s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:26.992183 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk.info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.022601 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "cp -r /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_resize/disk.info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" returned: 0 in 0.030s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.164919 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:31:27.169909 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:31:27.169909 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Creating image(s) Jul 05 03:31:27.169909 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:27.169909 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:27.169909 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:27.170629 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:27.174995 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:27.188747 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.211444 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:27.260197 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:27.260448 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:27.277220 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.091s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.277927 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:27.278455 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:27.279595 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:27.280498 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:27.283922 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:27.284083 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.301240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:27.385659 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.102s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.388860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.432437 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk 1073741824" returned: 0 in 0.046s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.435850 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:27.435850 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.512651 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.078s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.516740 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:31:27.516740 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:27.545415 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ac79b6f1-906e-4537-ac7a-279d218ad4e2 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "229ef5ac-5766-4a82-98f2-3c6e6d44cda1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.373s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:27.599920 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Cannot resize image /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Ensure instance console log exists: /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:27.602270 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:27.716165 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31b141a0-4c32-41bb-b536-98e841b53f3e req-a2b7d659-36cc-4eeb-9ed5-4a8e88b20d3d service nova] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:27.716761 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:27.717372 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:27.765606 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:27.824685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-71f0a8b6-2f98-438d-9fa3-c22d6ad668fc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.506s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:28.151298 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for a123d3ff-9f01-46b6-838c-11bc579124ec due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:31:28.151472 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:28.151550 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Resumed (Lifecycle Event) Jul 05 03:31:28.153674 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-58a0df6c-f083-47e0-b222-96c324b36145 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:28.248545 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:28.248824 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:28.274350 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.845s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:28.275616 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.389s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:28.289443 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:28.352435 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Port 8c91f432-9afa-42c0-95c5-81ebf116e5e9 binding to destination host np0000004562 is already ACTIVE {{(pid=99148) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jul 05 03:31:28.373417 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Deleted allocations for instance dceabcd9-3341-412c-8492-121a739b626d Jul 05 03:31:28.530087 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:28.568007 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:28.568555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:28.568733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:28.568872 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:28.569038 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:28.569229 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-111e5dbe-720c-47bf-8ec0-f25687b003ad req-ce59a4cd-15f5-4fff-a0a2-894039212cc3 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state active and task_state resize_migrating. Jul 05 03:31:28.653765 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:28.655207 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:28.716069 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:28.798786 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:28.799130 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:28.939205 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:28.939416 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:29.161916 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:29.162081 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Started (Lifecycle Event) Jul 05 03:31:29.218135 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:29.218390 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance network_info: |[{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:31:29.222098 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start _get_guest_xml network_info=[{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:29.229961 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:29.231695 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-561721903', uuid='7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222289.2310474) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:29.233929 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:29.233929 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:29.234528 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:29.234890 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:29.236113 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:29.236544 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:29.237786 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:29.248891 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-561721903',display_name='tempest-ServerRescueNegativeTestJSON-server-561721903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-561721903',id=14,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5C1PD7kMqh+7KVuuShtRFCyVUOnOd/2IlikAG4AzRLIo5GTkr7ifn9Wd/Ybwxq52FR0i5LiFl0RT1NSP3Zf/7oDmhZv5cJa8w5AI2yZF3+uyyVWgxfGq6Z+37o9w5PRQ==',key_name='tempest-keypair-651564886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-exzz2q3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:29.250651 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:29.250651 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:29.250651 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:29.301754 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Detaching volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:29.363111 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:31:29.375118 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Attempting to driver detach volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc from mountpoint /dev/vdb Jul 05 03:31:29.383034 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:29.396389 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.013s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:29.400501 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.005s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:29.402790 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found disk vdb by alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:29.403687 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3f7769d3-9c77-4d69-9b02-7a39c2350a96 tempest-AttachSCSIVolumeTestJSON-594600634 tempest-AttachSCSIVolumeTestJSON-594600634-project-member] Lock "dceabcd9-3341-412c-8492-121a739b626d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.635s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:29.405563 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found disk vdb by alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:29.405752 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Attempting to detach device vdb from instance a5af3d1a-6bd5-427a-90fd-2a464878e157 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] detach device xml: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]:
Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: Jul 05 03:31:29.406148 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:29.413473 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully detached device vdb from instance a5af3d1a-6bd5-427a-90fd-2a464878e157 from the persistent domain config. Jul 05 03:31:29.413729 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] (1/8): Attempting to detach device vdb with device alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc from instance a5af3d1a-6bd5-427a-90fd-2a464878e157 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] detach device xml: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]:
Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: Jul 05 03:31:29.414044 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:29.442043 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:29.664846 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:29.666585 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] End _get_guest_xml xml= Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: instance-0000000e Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 196608 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-561721903 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 2026-07-05 03:31:29 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 192 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: True Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: bare Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Preparing to wait for external event network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-561721903',display_name='tempest-ServerRescueNegativeTestJSON-server-561721903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-561721903',id=14,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5C1PD7kMqh+7KVuuShtRFCyVUOnOd/2IlikAG4AzRLIo5GTkr7ifn9Wd/Ybwxq52FR0i5LiFl0RT1NSP3Zf/7oDmhZv5cJa8w5AI2yZF3+uyyVWgxfGq6Z+37o9w5PRQ==',key_name='tempest-keypair-651564886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-exzz2q3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:31:29.756741 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:29.761368 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:29.761368 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:31:29.761731 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.762020 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:29.762255 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:31:29.763897 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.764095 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97f0f8f8-f586-5a8e-9f18-d948be066920', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:29.764817 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.765439 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:29.766494 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.768423 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.768592 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae99d539-26, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:29.768894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae99d539-26, col_values=(('qos', UUID('4f262072-176b-4f92-9052-e2d294a28fa9')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:29.769060 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae99d539-26, col_values=(('external_ids', {'iface-id': 'ae99d539-260e-4455-b60f-28b27e1002a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:41:ed', 'vm-uuid': '7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:29.769807 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.770861 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:29.777332 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.784582 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.786623 np0000004562 nova-compute[99148]: INFO os_vif [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') Jul 05 03:31:29.819627 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.820952 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.860943 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:29.861146 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:29.938524 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc for instance a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:31:29.950691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.675s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:29.978705 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:29.980618 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2bea9811-344d-44dd-8a8b-59ae13ea182f req-528c4e8b-e7a4-49d6-b212-ecbdc6bdbd6d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:29.980887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2bea9811-344d-44dd-8a8b-59ae13ea182f req-528c4e8b-e7a4-49d6-b212-ecbdc6bdbd6d service nova] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:29.981033 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2bea9811-344d-44dd-8a8b-59ae13ea182f req-528c4e8b-e7a4-49d6-b212-ecbdc6bdbd6d service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:29.981164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2bea9811-344d-44dd-8a8b-59ae13ea182f req-528c4e8b-e7a4-49d6-b212-ecbdc6bdbd6d service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:29.981265 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2bea9811-344d-44dd-8a8b-59ae13ea182f req-528c4e8b-e7a4-49d6-b212-ecbdc6bdbd6d service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Processing event network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:31:29.981906 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:30.030135 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Deleted allocations for instance d5282468-599f-4af3-b640-af72408dd7d6 Jul 05 03:31:30.169621 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:31:30.172118 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully detached device vdb from instance a5af3d1a-6bd5-427a-90fd-2a464878e157 from the live domain config. Jul 05 03:31:30.367636 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:31:30.408488 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:30.518291 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:30.519733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:30.519733 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:30.723169 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Detected multiple connections on this host for volume: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, skipping target disconnect. Jul 05 03:31:30.914392 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:30.914576 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:30.917451 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:30.917596 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Claim successful on node np0000004562 Jul 05 03:31:31.021416 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:31.050429 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-33ba68c2-9eb4-42a2-98e4-eec5c7d11fd0 tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Lock "d5282468-599f-4af3-b640-af72408dd7d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.598s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:31.291951 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:31.307951 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:31.308102 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:31.308210 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:73:41:ed, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:31.308630 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Using config drive Jul 05 03:31:31.351049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:31.370642 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:31.506131 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:31.816648 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:31.926167 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Creating config drive at /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config Jul 05 03:31:31.933193 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8tlgv0dm {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:31.984110 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8tlgv0dm" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:32.011513 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:32.047792 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:32.047792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:32.047792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:32.047792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:32.048021 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] No waiting events found dispatching network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:32.048120 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-f77e85d3-537d-46be-b30e-29ea48b1f2f3 req-5dccc9db-b771-48ea-a7cd-82d41b3e0bad service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received unexpected event network-vif-plugged-ae99d539-260e-4455-b60f-28b27e1002a8 for instance with vm_state building and task_state spawning. Jul 05 03:31:32.297843 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9dff746c-eaca-41df-afe0-dee77f839f82 tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.499s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:32.411239 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:32.422920 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:32.525279 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:32.542912 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:32.564700 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:32.597369 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:32.597369 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:32.611458 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:32.617702 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fe2f:70b2', 'fe80::b01d:23ff:fee8:104a', 'fe80::f816:3eff:fe1e:a559', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fee0:d026', 'fe80::f816:3eff:fefe:83c', 'fe80::b0ea:71ff:feb9:9e59', 'fe80::f816:3eff:feef:2cc2', 'fe80::f816:3eff:fe1b:e817', 'fe80::f816:3eff:fecc:29d3', 'fe80::f816:3eff:fe43:aa9b', 'fe80::f816:3eff:feef:b12', 'fe80::b088:8aff:fe4b:763b', 'fe80::ac89:37ff:fe59:e7d0', 'fe80::54fc:c4ff:fecf:ad43', 'fe80::7406:13ff:fe83:c267', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed'] Jul 05 03:31:32.617702 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:32.617702 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:32.617702 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:32.644919 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:32.646480 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:33.004912 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004968109999481385 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:33.005508 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:33.005746 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:33.005879 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] VM Stopped (Lifecycle Event) Jul 05 03:31:33.006885 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.614017494000109 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:33.006943 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.613887452999961 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:33.149133 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:33.216069 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:33.216479 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:31:33.216663 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Started (Lifecycle Event) Jul 05 03:31:33.218999 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:31:33.223434 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance spawned successfully. Jul 05 03:31:33.223679 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:31:33.270354 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:33.270662 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:33.508898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: 229ef5ac-5766-4a82-98f2-3c6e6d44cda1] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:33.544827 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:33.658258 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.744s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:33.658799 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:31:33.719852 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:33.730913 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:33.734919 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.734919 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.735583 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.735583 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.736040 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.736604 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:33.770902 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Starting finish_migration {{(pid=99148) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12859}} Jul 05 03:31:33.772605 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:31:33.772775 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Creating image(s) Jul 05 03:31:33.773695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:33.788747 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Detaching volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:33.800001 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:33.874221 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Attempting to driver detach volume 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc from mountpoint /dev/vdb Jul 05 03:31:33.875636 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.102s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:33.876150 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:31:33.876438 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:33.896076 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found disk vdb by alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:33.899332 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Found disk vdb by alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:31:33.899332 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Attempting to detach device vdb from instance 8925c8cc-b844-4697-9d32-99d9b39c394f from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] detach device xml: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]:
Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: Jul 05 03:31:33.899526 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:33.905974 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully detached device vdb from instance 8925c8cc-b844-4697-9d32-99d9b39c394f from the persistent domain config. Jul 05 03:31:33.906214 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] (1/8): Attempting to detach device vdb with device alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc from instance 8925c8cc-b844-4697-9d32-99d9b39c394f from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] detach device xml: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: 7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]:
Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: Jul 05 03:31:33.906945 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:31:33.963510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:33.964162 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Cannot resize image /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:31:34.045739 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:34.045739 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:34.045739 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:34.045739 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:34.046454 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:34.051062 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Terminating instance Jul 05 03:31:34.166399 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:31:34.166789 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:31:34.167196 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:34.167908 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:34.233428 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:31:34.233823 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:34.233930 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Paused (Lifecycle Event) Jul 05 03:31:34.238571 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87700afdc5b8465bb1fb235e2ebf6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3465ef2c67b48a5a9eeb4bea4ff9fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:31:34.242799 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Took 7.08 seconds to spawn the instance on the hypervisor. Jul 05 03:31:34.243155 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:34.470463 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:31:34.473731 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Ensure instance console log exists: /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:31:34.473731 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:34.473731 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:34.473731 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:34.475691 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start _get_guest_xml network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '605e43a3-b2f4-4a67-9458-4ad0aa6b196d', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '56f86925-1417-4995-8ffe-d5c410bc7613', 'attached_at': '2026-07-05T03:31:33.000000', 'detached_at': '', 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'serial': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:34.479828 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:34.479828 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-677853189', uuid='56f86925-1417-4995-8ffe-d5c410bc7613'), owner=OwnerMeta(userid='5f75c839862741bda4735a21795759ce', username='tempest-ServerActionsTestOtherB-2067268672-project-member', projectid='026b2963073e4b6ca4fa964dbc89d833', projectname='tempest-ServerActionsTestOtherB-2067268672'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222294.479362) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:34.481931 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:34.481931 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:34.482986 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:34.483318 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:34.486737 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:34.504732 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:34.552620 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:34.558753 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:34.574114 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:34.581131 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config --force-share --output=json" returned: 0 in 0.078s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:34.582134 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:34.582134 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:34.584596 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:34.597376 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:34.597996 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:34.598558 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:34.599116 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:34.599372 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:34.599615 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:34.610412 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:34.610412 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:34.616066 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:34.616066 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:34.622649 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:34.622920 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:34.623124 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:34.623299 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:34.627074 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:34.627304 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:34.627427 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:34.627581 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:34.636722 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Successfully created port: efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:31:34.670827 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:31:34.741567 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:34.743207 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:34.743373 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Resumed (Lifecycle Event) Jul 05 03:31:34.753996 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Took 15.58 seconds to build instance. Jul 05 03:31:34.770462 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:34.855497 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Instance destroyed successfully. Jul 05 03:31:34.856113 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lazy-loading 'resources' on Instance uuid ee8c5417-25e7-44b1-847c-6c989397ec07 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:35.159625 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Successfully updated port: efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:31:35.177686 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:31:35.231525 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-changed-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:35.232286 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Refreshing instance network info cache due to event network-changed-efa430bb-f196-4ebf-96da-ef606d52fe85. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:35.233100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] Acquiring lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:35.233565 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] Acquired lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:35.233746 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Refreshing network info cache for port efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:35.246047 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:35.251519 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:35.256703 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0220ecee-9a5c-42eb-8572-448c9d7763fd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.092s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:35.358662 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549977290',display_name='tempest-ServersNegativeTestJSON-server-1549977290',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serversnegativetestjson-server-1549977290',id=12,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:00Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='55da77bd22354fce84a6e3ff834c8d0f',ramdisk_id='',reservation_id='r-j7ncgjv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-789470158',owner_user_name='tempest-ServersNegativeTestJSON-789470158-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:01Z,user_data=None,user_id='073872262a6341338d468bb869b1bf02',uuid=ee8c5417-25e7-44b1-847c-6c989397ec07,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:35.358915 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converting VIF {"id": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "address": "fa:16:3e:57:cd:0a", "network": {"id": "cf6f290c-d6bf-45fc-9d6c-bb17e4644194", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-237944615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55da77bd22354fce84a6e3ff834c8d0f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8f8b70-25", "ovs_interfaceid": "5e8f8b70-2560-4243-8cfe-4ab4a8c8778f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:35.359722 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:35.360058 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:35.382453 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.389843 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.403814 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.404822 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e8f8b70-25, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:35.407755 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:35.408749 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.408913 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6441a1d0-5f6e-4527-aebb-56abc3bff2e5) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:35.409551 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.410109 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:35.410531 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.414926 np0000004562 nova-compute[99148]: INFO os_vif [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cd:0a,bridge_name='br-int',has_traffic_filtering=True,id=5e8f8b70-2560-4243-8cfe-4ab4a8c8778f,network=Network(cf6f290c-d6bf-45fc-9d6c-bb17e4644194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8f8b70-25') Jul 05 03:31:35.415273 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Deleting instance files /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07_del Jul 05 03:31:35.416051 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Deletion of /opt/stack/data/nova/instances/ee8c5417-25e7-44b1-847c-6c989397ec07_del complete Jul 05 03:31:35.421559 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.446410 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.448062 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.622417 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0015225719998852583 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:35.622615 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:35.622615 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.7640259310001056 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:35.622729 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.7639458720000221 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:35.623256 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:35.623507 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] VM Stopped (Lifecycle Event) Jul 05 03:31:35.625882 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:35.628225 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:35.639459 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:35.650933 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.658053 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.661735 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:35.669602 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.679063 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.679478 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.691689 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.692065 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:35.700828 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:35.733578 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:31:35.733578 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:31:35.733578 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.737615 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:35.737615 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:35.737870 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:35.737870 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:35.738765 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] No waiting events found dispatching network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:35.738765 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d01ed9d1-5273-425a-8dca-60c79513083b req-fae9c7fd-5270-4bcd-b2d4-6238f06e53e0 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:35.739018 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:35.747031 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.754744 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999769070999946 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:35.763817 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:31:35.763817 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:31:35.763817 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.770532 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:35.771106 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:35.772095 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('15', '-', '-', 0) found on session 21 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:35.772226 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:35.777450 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 21 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:35.798183 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:35.799032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:35.799032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:35.800008 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('16', '-', '-', 0) found on session 22 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:35.800147 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:35.815168 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 22 and hctl ['16', '*', '*', 0] yield: None {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:35.832472 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:35.929687 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Took 1.38 seconds to destroy the instance on the hypervisor. Jul 05 03:31:35.934088 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:35.934523 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:35.934764 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:35.935982 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:35.974059 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:36.045001 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:36.126259 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: dceabcd9-3341-412c-8492-121a739b626d] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:36.155685 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:36.188396 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:31:36.189768 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:31:36.190274 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Creating image(s) Jul 05 03:31:36.190883 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:36.191078 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:36.191655 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:36.192302 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:36.197440 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:36.200587 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:36.312577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.112s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:36.313565 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:31:36.314343 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc for instance 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:31:36.314750 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:36.315411 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:36.315980 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:36.321705 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:36.322785 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:36.339208 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully detached device vdb from instance 8925c8cc-b844-4697-9d32-99d9b39c394f from the live domain config. Jul 05 03:31:36.354652 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:36.387166 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004944679999425716 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:36.389050 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:36.389328 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:36.389581 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:36.390098 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] VM Stopped (Lifecycle Event) Jul 05 03:31:36.391982 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.856908973999907 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:36.392158 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:36.392305 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.856553683999891 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:36.392427 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:36.408914 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:36.409481 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:36.462658 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk 1073741824" returned: 0 in 0.053s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:36.463935 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.148s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:36.465309 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:36.550630 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-ab4e8f26-e78c-47d2-9fa3-de1e5583fde6 req-0ed72df8-978b-4f65-aa8c-37db8635afec service nova] Releasing lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:36.551372 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:36.551595 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:36.560159 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:36.560526 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:31:36.560787 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:36.650788 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:36.651418 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Cannot resize image /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:31:36.651996 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:31:36.652270 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Ensure instance console log exists: /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:31:36.652627 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:36.653147 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:36.653147 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:36.815868 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 22 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:36.816098 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:36.894445 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: d5282468-599f-4af3-b640-af72408dd7d6] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:36.955887 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:37.111252 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:37.305106 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:37.308623 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing instance network info cache due to event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:37.308867 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:37.309282 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:37.310429 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:37.333272 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:37.459125 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Took 1.52 seconds to deallocate network for instance. Jul 05 03:31:37.533184 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Updating instance_info_cache with network_info: [{"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:37.623645 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Found WWN 3300000008471b24d for multipath device dm-6 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:31:37.623645 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:37.623890 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-6', 'multipath_id': '3300000008471b24d'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:37.624009 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-6', 'multipath_id': '3300000008471b24d'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:31:37.624827 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.232s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:37.625739 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:37.626358 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:37.658898 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:37.659254 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:37.659474 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:37.659474 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '19')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:37.660912 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc', '20')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:37.666277 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Resulting device map defaultdict(. at 0x7249ac67c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'): ({'sdq'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:37.667730 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Removing multipathed devices sdq, sdp {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:37.667730 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Flush multipath device 3300000005bdd2706 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:37.706526 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:37.759644 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:37.818919 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:37.818919 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:37.818919 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:37.818919 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:37.829794 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:37.830081 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:37.838833 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:37.839142 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] Acquiring lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:37.839353 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:37.839456 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:37.839737 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] No waiting events found dispatching network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:37.839737 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received unexpected event network-vif-unplugged-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f for instance with vm_state deleted and task_state None. Jul 05 03:31:37.839821 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4f04343d-dd52-4178-94f3-482636dfbda3 req-15301210-cc8f-4b79-9f3b-f44e9a3a6d06 service nova] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Received event network-vif-deleted-5e8f8b70-2560-4243-8cfe-4ab4a8c8778f {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:37.845771 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:37.889383 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.40.100,3260] Jul 05 03:31:37.889383 np0000004562 nova-compute[99148]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.40.100,3260] successful. Jul 05 03:31:37.889383 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:37.913107 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:37.915052 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:37.926619 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:37.968631 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:37.968915 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:37.980371 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.50.100,3260] Jul 05 03:31:37.980371 np0000004562 nova-compute[99148]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-7fe5178f-2c9e-40ba-b4d1-87279ca7a6bc, portal: 192.168.50.100,3260] successful. Jul 05 03:31:37.980371 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:38.005705 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:38.006057 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:38.006234 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] <== disconnect_volume: return (1613ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:38.006397 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:38.036237 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-28b3c393-2575-4bb8-af24-988f514af885" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:38.036392 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance network_info: |[{"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:31:38.039658 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Start _get_guest_xml network_info=[{"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:38.044533 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:38.045486 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-899021781', uuid='28b3c393-2575-4bb8-af24-988f514af885'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222298.0450554) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:38.047235 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:38.047971 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:38.049042 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:38.049792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:38.050472 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:38.050885 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:38.051097 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:38.051276 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:38.051523 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:38.059913 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:38.059913 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:38.059913 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:38.060341 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:38.061064 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:38.061064 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:38.061064 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:38.083039 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-899021781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-899021781',id=15,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-08446pw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:35Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=28b3c393-2575-4bb8-af24-988f514af885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:38.083321 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:38.084126 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:38.085450 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid 28b3c393-2575-4bb8-af24-988f514af885 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:38.132419 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:23Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:31:38.132652 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:38.133151 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] End _get_guest_xml xml= Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: instance-00000003 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 262144 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-server-677853189 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 2026-07-05 03:31:34 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 256 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: True Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: bare Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: ide Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: pc Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672-project-member Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: 63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: Jul 05 03:31:38.134475 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:38.138100 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:23Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:31:38.138100 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117931664-network", "vif_mac": "fa:16:3e:0f:da:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:38.138100 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:38.138100 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:31:38.138880 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.139384 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.139530 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:31:38.145082 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.145320 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '378c4ad4-9eda-5c54-b6ef-0de45d9ad0aa', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.147005 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.148060 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:38.148169 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.153580 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.154053 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c91f432-9a, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.154403 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c91f432-9a, col_values=(('qos', UUID('56afc98f-e8ea-4ca1-acdb-fd7278b77dca')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.154570 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c91f432-9a, col_values=(('external_ids', {'iface-id': '8c91f432-9afa-42c0-95c5-81ebf116e5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:da:ea', 'vm-uuid': '56f86925-1417-4995-8ffe-d5c410bc7613'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.155721 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.156822 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:38.162240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.170884 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.172659 np0000004562 nova-compute[99148]: INFO os_vif [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:31:38.204215 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.210538 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.378833 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:38.544892 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.549393 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.555126 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.579314 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] End _get_guest_xml xml= Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 28b3c393-2575-4bb8-af24-988f514af885 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: instance-0000000f Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 196608 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-899021781 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 2026-07-05 03:31:38 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 192 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: True Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: bare Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 0 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: virtio Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 28b3c393-2575-4bb8-af24-988f514af885 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 28b3c393-2575-4bb8-af24-988f514af885 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: hvm Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 128 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: 1 Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: Jul 05 03:31:38.588365 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:31:38.591661 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Preparing to wait for external event network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:31:38.591661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:38.591661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:38.591661 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:38.591661 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-899021781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-899021781',id=15,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-08446pw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:35Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=28b3c393-2575-4bb8-af24-988f514af885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:31:38.592501 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:38.596474 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:38.596913 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:31:38.599832 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updated VIF entry in instance network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:31:38.600412 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.600972 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:38.601959 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.602184 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:31:38.604369 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.604588 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '715844a7-4b54-5219-8764-90020c11c5b7', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.608497 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:38.609178 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.612030 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.612305 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefa430bb-f1, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.612666 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefa430bb-f1, col_values=(('qos', UUID('a2bed7f9-9653-4a39-9320-3250d0c371b3')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.612863 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefa430bb-f1, col_values=(('external_ids', {'iface-id': 'efa430bb-f196-4ebf-96da-ef606d52fe85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:9a:d0', 'vm-uuid': '28b3c393-2575-4bb8-af24-988f514af885'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:38.615593 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:38.621098 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.625676 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'flavor' on Instance uuid 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:38.631499 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.643095 np0000004562 nova-compute[99148]: INFO os_vif [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') Jul 05 03:31:38.664579 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.815060 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:38.815364 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:38.851517 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:38.855478 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:39.104628 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-088b7d9a-b8e9-45ef-9758-92af7ffe53d0 req-b523ee3e-0563-469f-a7e6-b22f7438440a service nova] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:39.318337 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:39.395299 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:39.397389 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:39.397611 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:39.397802 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.398098 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:39.398377 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state active and task_state resize_finish. Jul 05 03:31:39.398580 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:39.398757 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:39.398920 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:39.399157 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.399266 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:39.401755 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state active and task_state resize_finish. Jul 05 03:31:39.402606 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:39.402794 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:39.402965 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:39.403132 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.403280 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Processing event network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:31:39.403449 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:39.403561 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:39.403706 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:39.403863 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.404007 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] No waiting events found dispatching network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:39.404110 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-20fe8cd1-b703-4536-b317-50ad78bb847b req-b47664ba-7c36-44b5-857b-83866f39a183 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received unexpected event network-vif-plugged-efa430bb-f196-4ebf-96da-ef606d52fe85 for instance with vm_state building and task_state spawning. Jul 05 03:31:39.633558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f0c998eb-478b-4794-91fc-53dd4e7f79fb tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.363s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.703195 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:39.703195 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:39.703195 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:39.703195 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] No VIF found with MAC fa:16:3e:0f:da:ea, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:39.703195 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Using config drive Jul 05 03:31:39.824694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.856s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:39.886234 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Deleted allocations for instance ee8c5417-25e7-44b1-847c-6c989397ec07 Jul 05 03:31:40.171278 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:40.171494 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:31:40.171673 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:47:9a:d0, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:31:40.173065 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Using config drive Jul 05 03:31:40.178592 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:40.192089 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:40.683018 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:40.749381 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:40.749526 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:40.749691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:40.749975 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:40.749975 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:40.751684 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Terminating instance Jul 05 03:31:40.837226 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Creating config drive at /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.config Jul 05 03:31:40.841538 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmpga9t7k {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:40.883592 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:40.883922 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:40.884916 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:40.884916 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:40.886144 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmpga9t7k" returned: 0 in 0.044s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:40.886361 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:40.891123 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Terminating instance Jul 05 03:31:40.898954 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05eb408d-9aa5-40f3-a730-b1f2a5f529b8 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Lock "ee8c5417-25e7-44b1-847c-6c989397ec07" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.853s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:41.247164 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 56f86925-1417-4995-8ffe-d5c410bc7613 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:31:41.247366 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:41.247542 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Resumed (Lifecycle Event) Jul 05 03:31:41.249729 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0008042479998948693 future=) was cancelled during its delay period, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.249896 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.250379 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.01777362699999685 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.251251 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=0.0173603999999159 future=) was cancelled while queued, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.254746 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.254746 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.502095675999954 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.254746 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.501971194999896 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:41.254746 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance event wait completed in 0 seconds for {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:31:41.254746 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:41.255668 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance running successfully. Jul 05 03:31:41.260515 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Failed to set time: agent not configured {{(pid=99148) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jul 05 03:31:41.260636 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-8150636f-31c0-41eb-b3d8-4358a70cb6f5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] finish_migration finished successfully. {{(pid=99148) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12954}} Jul 05 03:31:41.275704 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.291444 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.358054 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.378874 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.395186 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:41.406864 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.419110 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:41.754358 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:41.765950 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:41.778049 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Instance destroyed successfully. Jul 05 03:31:41.779024 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'resources' on Instance uuid a5af3d1a-6bd5-427a-90fd-2a464878e157 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:41.782756 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Instance destroyed successfully. Jul 05 03:31:41.783354 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lazy-loading 'resources' on Instance uuid 8925c8cc-b844-4697-9d32-99d9b39c394f {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:42.271480 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] During sync_power_state the instance has a pending task (resize_finish). Skip. Jul 05 03:31:42.271843 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:42.271960 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Started (Lifecycle Event) Jul 05 03:31:42.283433 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-1',id=6,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:26Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=a5af3d1a-6bd5-427a-90fd-2a464878e157,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:42.283433 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "e965727e-40f0-49fd-9c81-02b644cb02a5", "address": "fa:16:3e:2f:70:b2", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape965727e-40", "ovs_interfaceid": "e965727e-40f0-49fd-9c81-02b644cb02a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:42.283918 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:42.287106 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:42.289514 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1704194434-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-testmultiattachvolumeswap-server-1704194434-2',id=7,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJklB3cU+t3yq3Xch8SvsQQL2a3UAUj8PDBu99NJvjZ9DZO3RMT+pO1GA5EeqAcHerQErVcrrQjN+b6+GYJTtlD7Rw7ue9NcpLdABNwGhAbTNau0zT9SdibXHN+X1pSA==',key_name='tempest-keypair-22288915',keypairs=,launch_index=1,launched_at=2026-07-05T03:30:28Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3821d2d075c94e5499a469f3ef5e7c47',ramdisk_id='',reservation_id='r-j8w00fls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-530722390',owner_user_name='tempest-TestMultiAttachVolumeSwap-530722390-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2d4d36c2742ffb406ab17c8ced7e1',uuid=8925c8cc-b844-4697-9d32-99d9b39c394f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:42.289726 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converting VIF {"id": "066bb55b-ad03-4207-b570-25e22bfbb480", "address": "fa:16:3e:1e:a5:59", "network": {"id": "abc9607e-b3af-4e8a-bd54-ea2c82c22b44", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-153514641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3821d2d075c94e5499a469f3ef5e7c47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap066bb55b-ad", "ovs_interfaceid": "066bb55b-ad03-4207-b570-25e22bfbb480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:42.290155 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:42.290391 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:42.332338 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.332647 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape965727e-40, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:42.341229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:42.382703 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.392382 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.418379 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.419293 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.419293 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.419922 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap066bb55b-ad, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:42.421819 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.422268 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:42.422502 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.424281 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.424440 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0c60c3b-c5d7-44dd-b1f4-a14f4ca04026) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:42.425053 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.425543 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:42.426412 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.426863 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.429013 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e75eb3c3-9e32-43db-9f6b-e49195a92c28) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:42.429488 np0000004562 nova-compute[99148]: INFO os_vif [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:59,bridge_name='br-int',has_traffic_filtering=True,id=066bb55b-ad03-4207-b570-25e22bfbb480,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap066bb55b-ad') Jul 05 03:31:42.430460 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:42.431265 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Deleting instance files /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f_del Jul 05 03:31:42.431265 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.433818 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Deletion of /opt/stack/data/nova/instances/8925c8cc-b844-4697-9d32-99d9b39c394f_del complete Jul 05 03:31:42.436358 np0000004562 nova-compute[99148]: INFO os_vif [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=e965727e-40f0-49fd-9c81-02b644cb02a5,network=Network(abc9607e-b3af-4e8a-bd54-ea2c82c22b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape965727e-40') Jul 05 03:31:42.436684 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Deleting instance files /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157_del Jul 05 03:31:42.437557 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Deletion of /opt/stack/data/nova/instances/a5af3d1a-6bd5-427a-90fd-2a464878e157_del complete Jul 05 03:31:42.555913 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.557354 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.586970 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.625584 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.628595 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:31:42.633781 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:31:42.635848 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance spawned successfully. Jul 05 03:31:42.636216 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:31:42.694886 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:42.740528 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:42.740903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:42.741167 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:42.741281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:42.741391 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] No waiting events found dispatching network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:42.741502 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6461922c-4163-4ca3-85d9-e28d9be67954 req-7f6243f2-e5ad-4c56-b827-ce1576528715 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:42.774309 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:42.776849 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:42.954979 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Took 1.70 seconds to destroy the instance on the hypervisor. Jul 05 03:31:42.957477 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:42.958397 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Took 1.56 seconds to destroy the instance on the hypervisor. Jul 05 03:31:42.959337 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:42.959824 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:42.960052 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:42.960497 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:42.960918 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:42.962790 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:42.963285 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:43.145034 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.145034 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.145034 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.145247 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.145599 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.146352 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:31:43.149286 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:43.149555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:43.149851 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:43.150037 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:43.150206 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:43.154774 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Terminating instance Jul 05 03:31:43.271513 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:43.281601 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.99968575600019 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:43.281940 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999776104000148 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:43.282223 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:43.286064 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] VM Started (Lifecycle Event) Jul 05 03:31:43.347376 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:43.379325 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:43.655777 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Took 7.47 seconds to spawn the instance on the hypervisor. Jul 05 03:31:43.656509 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:43.664850 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:31:43.677016 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:43.687706 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:43.788509 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:43.798211 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:43.850629 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a8231ce-16c9-4849-add1-18ff653c5c8c req-9067a482-c3c8-45d7-97c5-ad4b4a4bcba2 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-deleted-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:43.850817 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-2a8231ce-16c9-4849-add1-18ff653c5c8c req-9067a482-c3c8-45d7-97c5-ad4b4a4bcba2 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Neutron deleted interface e965727e-40f0-49fd-9c81-02b644cb02a5; detaching it from the instance and deleting it from the info cache Jul 05 03:31:43.853439 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a8231ce-16c9-4849-add1-18ff653c5c8c req-9067a482-c3c8-45d7-97c5-ad4b4a4bcba2 service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Detach interface failed, port_id=e965727e-40f0-49fd-9c81-02b644cb02a5, reason: Instance a5af3d1a-6bd5-427a-90fd-2a464878e157 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:43.979627 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d7da3546-2e6f-42dc-9608-e06dd0cdac47 req-0c357387-61f9-409b-83a6-b6713f4d48c0 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-deleted-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:43.979627 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-d7da3546-2e6f-42dc-9608-e06dd0cdac47 req-0c357387-61f9-409b-83a6-b6713f4d48c0 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Neutron deleted interface 066bb55b-ad03-4207-b570-25e22bfbb480; detaching it from the instance and deleting it from the info cache Jul 05 03:31:43.992039 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d7da3546-2e6f-42dc-9608-e06dd0cdac47 req-0c357387-61f9-409b-83a6-b6713f4d48c0 service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Detach interface failed, port_id=066bb55b-ad03-4207-b570-25e22bfbb480, reason: Instance 8925c8cc-b844-4697-9d32-99d9b39c394f could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:44.000265 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Instance destroyed successfully. Jul 05 03:31:44.002880 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lazy-loading 'resources' on Instance uuid 7f4104ac-fa7c-495a-9f64-c9b835bc6073 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:44.171980 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Took 13.30 seconds to build instance. Jul 05 03:31:44.302152 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:44.303831 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:44.304208 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] VM Paused (Lifecycle Event) Jul 05 03:31:44.418284 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:44.463392 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:44.509797 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.510073 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "address": "fa:16:3e:e0:d0:26", "network": {"id": "ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1467536951-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb05efe-1c", "ovs_interfaceid": "7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.510786 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.511152 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.546771 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.549538 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.557315 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.557315 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cb05efe-1c, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.561105 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.561494 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.579556 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.581311 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.581536 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eb4d151-6595-41e2-b56e-56341b86da8a) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.585612 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.586495 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.611215 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.611215 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.613033 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:d0:26,bridge_name='br-int',has_traffic_filtering=True,id=7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99,network=Network(ce6c3f04-3e3e-484b-9dba-d9bb6cb6960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb05efe-1c') Jul 05 03:31:44.613753 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.614005 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "bb2e32c9-4929-4707-8b62-218476108cc2", "address": "fa:16:3e:fe:08:3c", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2e32c9-49", "ovs_interfaceid": "bb2e32c9-4929-4707-8b62-218476108cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.614405 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.614628 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.653512 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.658402 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.675240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.675240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb2e32c9-49, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.675240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.675240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.675240 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-3e3a67a6-d7e4-4ea2-8309-1ffd6668d68c tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.813s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:44.680519 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.680519 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.686049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.686049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8feb40d9-3cee-49b5-b466-e81cad9cef13) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.686049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.686049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.688871 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:08:3c,bridge_name='br-int',has_traffic_filtering=True,id=bb2e32c9-4929-4707-8b62-218476108cc2,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb2e32c9-49') Jul 05 03:31:44.690044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.690044 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "address": "fa:16:3e:ef:2c:c2", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8af0e9b1-6c", "ovs_interfaceid": "8af0e9b1-6c97-4f9b-87b9-335bb6c672ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.693279 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.693279 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.740349 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.740561 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8af0e9b1-6c, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.746907 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.747726 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.758358 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.780341 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.784742 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.784742 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b784d037-5d00-4aa4-aec1-e3daf51bb28e) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.784742 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.785444 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.790988 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:2c:c2,bridge_name='br-int',has_traffic_filtering=True,id=8af0e9b1-6c97-4f9b-87b9-335bb6c672ec,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8af0e9b1-6c') Jul 05 03:31:44.791840 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.792080 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "address": "fa:16:3e:1b:e8:17", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap924b28f4-27", "ovs_interfaceid": "924b28f4-27f7-4a6b-aa53-667cdcec6779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.792826 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.795529 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.807944 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Took 1.85 seconds to deallocate network for instance. Jul 05 03:31:44.811841 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:44.818349 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:44.818611 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] VM Resumed (Lifecycle Event) Jul 05 03:31:44.822229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.842138 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.842138 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap924b28f4-27, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.845017 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.849276 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.852603 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.855307 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.855307 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cee89df6-a933-48f2-a104-bb00c1f91127) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.855655 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.856302 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.859384 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.862257 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e8:17,bridge_name='br-int',has_traffic_filtering=True,id=924b28f4-27f7-4a6b-aa53-667cdcec6779,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924b28f4-27') Jul 05 03:31:44.862257 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.862746 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "86bf53df-be71-4602-af51-8fdc20c2874d", "address": "fa:16:3e:cc:29:d3", "network": {"id": "eb5be750-5d10-41aa-9756-c937215b2595", "bridge": "br-int", "label": "tempest-device-tagging-net1-609422715", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bf53df-be", "ovs_interfaceid": "86bf53df-be71-4602-af51-8fdc20c2874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.863015 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.863094 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.890035 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.893435 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.897996 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.897996 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86bf53df-be, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.900056 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.903407 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.909891 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received event network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:44.909891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Acquiring lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:44.909891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:44.909891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:44.910540 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] No waiting events found dispatching network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:44.910540 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Received unexpected event network-vif-unplugged-e965727e-40f0-49fd-9c81-02b644cb02a5 for instance with vm_state deleted and task_state None. Jul 05 03:31:44.910540 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:44.910540 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:44.911141 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:44.912405 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:44.912405 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] No waiting events found dispatching network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:44.912405 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:44.913059 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:44.913059 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Acquiring lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:44.913059 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:44.913059 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:44.913059 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] No waiting events found dispatching network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:44.913658 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de648331-71ba-4200-bad8-5c1dc604bb3b req-6d912341-8b18-4a50-9edc-b62ae1db87be service nova] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Received event network-vif-unplugged-066bb55b-ad03-4207-b570-25e22bfbb480 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:44.920958 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.920958 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.920958 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b13a60d1-b5a6-4d09-a362-c08a1b27ab16) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.920958 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.921435 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.922058 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.923039 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Took 1.96 seconds to deallocate network for instance. Jul 05 03:31:44.924818 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:29:d3,bridge_name='br-int',has_traffic_filtering=True,id=86bf53df-be71-4602-af51-8fdc20c2874d,network=Network(eb5be750-5d10-41aa-9756-c937215b2595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bf53df-be') Jul 05 03:31:44.925464 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:44.925643 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "746e6639-5d12-4455-a62c-e72b29391501", "address": "fa:16:3e:43:aa:9b", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap746e6639-5d", "ovs_interfaceid": "746e6639-5d12-4455-a62c-e72b29391501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:44.926756 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:44.926756 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:44.940179 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.956842 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.956842 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.959488 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap746e6639-5d, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:44.961688 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:44.968484 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:44.991914 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:44.992383 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:44.993633 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:44.995639 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.001770 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.001958 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71f571bf-2ffe-4544-92c9-000f54854170) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:45.008143 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:45.017818 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.020487 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.025678 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:aa:9b,bridge_name='br-int',has_traffic_filtering=True,id=746e6639-5d12-4455-a62c-e72b29391501,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746e6639-5d') Jul 05 03:31:45.025678 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1167103678',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1167103678',id=8,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IWe3VcqGfsP9+6sIWBHw5kwx1m5pd2gcXQfEbLvUuj7NHAuw0HosjmNk+dnRztfrX/WBfc9Q2LGIe5isurywbM6TJlJxJty79anmrcR/TRgOt9dP4Qwxy3UtLEWTE9w==',key_name='tempest-keypair-1362656575',keypairs=,launch_index=0,launched_at=2026-07-05T03:30:59Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='76b6d7dab7b84017ad157933bc5f70e2',ramdisk_id='',reservation_id='r-0vdrs671',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1222577163',owner_user_name='tempest-TaggedBootDevicesTest_v242-1222577163-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6eeca41172e40e8a372cac82d88969c',uuid=7f4104ac-fa7c-495a-9f64-c9b835bc6073,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:45.025678 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converting VIF {"id": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "address": "fa:16:3e:ef:0b:12", "network": {"id": "168e2c0e-3615-421a-841e-c5a74da96393", "bridge": "br-int", "label": "tempest-device-tagging-net2-467487414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "76b6d7dab7b84017ad157933bc5f70e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b31dbd-b1", "ovs_interfaceid": "21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:45.025678 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:45.025678 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:45.061766 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.061766 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.061766 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21b31dbd-b1, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:45.069253 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.070499 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:45.087319 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.088782 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.088782 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b43390af-e4b3-44ba-8053-e3dafcb76bae) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:45.090080 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.090867 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:45.091277 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.093636 np0000004562 nova-compute[99148]: INFO os_vif [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0,network=Network(168e2c0e-3615-421a-841e-c5a74da96393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b31dbd-b1') Jul 05 03:31:45.094971 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:45.095444 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:45.096862 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:45.096862 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:45.096862 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:45.096862 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:45.131067 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf (non-flash) Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:45.131544 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '9')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.132690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf', '10')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.134216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Resulting device map defaultdict(. at 0x7249ac4759e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'): ({'sdg'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:45.134433 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Removing multipathed devices sdf, sdg {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:45.134728 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Flush multipath device 3300000007fda16e8 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:45.142412 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.151858 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Port 8c91f432-9afa-42c0-95c5-81ebf116e5e9 binding to destination host np0000004562 is already ACTIVE {{(pid=99148) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jul 05 03:31:45.152056 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:45.152137 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:45.152259 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:45.167501 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:45.184013 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:45.226803 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:45.274878 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6d0f8b55-965a-41f7-8e8e-1c237e7e2dfd req-0660ba9b-a28f-4966-9914-2b0252da8fb2 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:45.285246 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:45.285454 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:45.288650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:45.308846 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:45.308955 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:45.318600 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.318734 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.324090 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:45.327440 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:31:45.330229 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.371377 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.40.100,3260] Jul 05 03:31:45.371377 np0000004562 nova-compute[99148]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.40.100,3260] successful. Jul 05 03:31:45.371377 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.396183 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.421626 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.436094 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.468334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.50.100,3260] Jul 05 03:31:45.468334 np0000004562 nova-compute[99148]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-5c0b1bcc-d802-42f4-9516-cea433ce2cdf, portal: 192.168.50.100,3260] successful. Jul 05 03:31:45.468334 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.490050 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.490500 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:45.490638 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== disconnect_volume: return (394ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:45.490778 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:45.495005 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:45.496376 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:45.496536 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:45.497113 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:45.497696 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:45.498045 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae (non-flash) Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:45.546239 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '7')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.547464 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae', '8')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.554729 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Resulting device map defaultdict(. at 0x7249ac6e1b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'): ({'sde'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:45.554914 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Removing multipathed devices sde, sdd {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:45.555119 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Flush multipath device 330000000aaec149b {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:45.594245 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:45.658295 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:45.667036 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:45.727011 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:45.727011 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] SCSI volumes sde, sdd have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:45.727011 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:45.739165 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:45.739540 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:45.754994 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.796177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.40.100,3260] Jul 05 03:31:45.796177 np0000004562 nova-compute[99148]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.40.100,3260] successful. Jul 05 03:31:45.796177 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.822098 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.834502 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999647123999921 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:45.837701 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.874017 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.50.100,3260] Jul 05 03:31:45.874017 np0000004562 nova-compute[99148]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a2fde02a-b9ec-4b8b-9fd3-16bb942b6aae, portal: 192.168.50.100,3260] successful. Jul 05 03:31:45.874017 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.891743 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:45.891990 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:45.892970 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== disconnect_volume: return (395ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:45.892970 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0e67fcf-50f9-4356-986d-13c7a918e260', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:45.894861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:45.922320 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:45.923829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.923989 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.924095 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:45.924219 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:45.924326 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:45.925594 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:45.925594 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.925667 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.925799 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:45.926243 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.926756 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:45.927058 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260 (non-flash) Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '6')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.929047 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.929637 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:45.929637 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:45.930333 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:45.930488 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:45.930664 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:45.931789 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:45.932813 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:45.932813 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:45.934164 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1c6815e7-e8b8-47d6-9ce3-2a9529fbca19 req-b4dc3a28-8e41-4ac4-bfd8-b20b984fd88a service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-bb2e32c9-4929-4707-8b62-218476108cc2 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:45.934219 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260', '5')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:45.934947 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Resulting device map defaultdict(. at 0x7249ac475c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'): ({'sdb'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:45.935248 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:45.935611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Flush multipath device 3300000008f51efd0 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:45.999131 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:46.057292 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:46.076395 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:46.076650 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:46.105994 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:46.106537 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:46.108155 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:46.119700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:46.120000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:46.132287 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.148854 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:46.168139 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.40.100,3260] Jul 05 03:31:46.168139 np0000004562 nova-compute[99148]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.40.100,3260] successful. Jul 05 03:31:46.168139 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.184036 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.196817 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.237352 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.50.100,3260] Jul 05 03:31:46.237352 np0000004562 nova-compute[99148]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-d0e67fcf-50f9-4356-986d-13c7a918e260, portal: 192.168.50.100,3260] successful. Jul 05 03:31:46.237352 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.254924 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:46.254924 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:46.255105 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] <== disconnect_volume: return (361ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:46.255225 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:46.255695 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Deleting instance files /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073_del Jul 05 03:31:46.256102 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Deletion of /opt/stack/data/nova/instances/7f4104ac-fa7c-495a-9f64-c9b835bc6073_del complete Jul 05 03:31:46.334230 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:46.360681 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:46.580016 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:46.729348 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:46.763200 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Took 3.10 seconds to destroy the instance on the hypervisor. Jul 05 03:31:46.764149 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:31:46.764867 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:31:46.765028 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:31:46.765295 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:46.843440 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:46.849586 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:47.051140 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:47.052116 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:47.052511 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:47.052887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:47.055753 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:47.056052 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:47.056941 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:47.056941 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:47.056941 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:47.056941 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:47.056941 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:47.057148 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-924b28f4-27f7-4a6b-aa53-667cdcec6779 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:47.057148 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:47.057387 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:47.057489 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:47.058548 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:47.058699 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:47.058829 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8fa82638-aa23-4802-b3cf-cf25759772e0 req-460f1776-46b8-4f5c-9b11-d6506453a121 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:47.087843 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.769s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:47.089659 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.652s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:47.186396 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Deleted allocations for instance a5af3d1a-6bd5-427a-90fd-2a464878e157 Jul 05 03:31:47.236994 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] instance snapshotting Jul 05 03:31:47.350047 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Creating tmpfile /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/tmpz_4lwyat to verify with other compute node that the instance is on the same shared storage. {{(pid=99148) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10619}} Jul 05 03:31:47.350047 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:31:47.383514 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Beginning live snapshot process Jul 05 03:31:47.390370 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:47.392164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:47.392164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:47.392164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:47.392164 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:47.392164 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-41319027-63dd-4699-97d0-cf7d6a655fbf req-5d481fac-ebd4-4538-aaeb-c7c869989bc3 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:47.417580 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:47.752450 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:47.752662 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:47.854540 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:47.866052 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.169679 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999685446000058 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:48.172504 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance destroyed successfully. Jul 05 03:31:48.172504 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'resources' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:48.195674 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7121d328-1264-4f28-8fc3-6a8b34b6c1cc tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "a5af3d1a-6bd5-427a-90fd-2a464878e157" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.446s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:48.257837 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:48.348487 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cd209e14-b66b-42de-bf01-5ada21253045 req-021ecf28-1642-4228-ba8c-ce56ecec8651 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-deleted-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:48.349026 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-cd209e14-b66b-42de-bf01-5ada21253045 req-021ecf28-1642-4228-ba8c-ce56ecec8651 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Neutron deleted interface 746e6639-5d12-4455-a62c-e72b29391501; detaching it from the instance and deleting it from the info cache Jul 05 03:31:48.352794 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cd209e14-b66b-42de-bf01-5ada21253045 req-021ecf28-1642-4228-ba8c-ce56ecec8651 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Detach interface failed, port_id=746e6639-5d12-4455-a62c-e72b29391501, reason: Instance 7f4104ac-fa7c-495a-9f64-c9b835bc6073 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:48.680137 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:31:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:31:48.680137 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:31:48.680698 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:31:48.680698 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:31:48.706647 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.709451 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.725214 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.725867 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c91f432-9a, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:48.726787 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.727590 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:48.731687 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.733991 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.734413 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.734525 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56afc98f-e8ea-4ca1-acdb-fd7278b77dca) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:31:48.734969 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.735460 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:31:48.753468 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.755113 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:48.762176 np0000004562 nova-compute[99148]: INFO os_vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:31:48.763396 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:31:48.763784 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:48.763995 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:48.765200 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.677s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:48.767129 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:48.767786 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:31:48.767976 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:31:48.799391 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:48.799391 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:48.799391 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:48.799391 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:48.799391 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:31:48.799938 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '21')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:48.807000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '22')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:31:48.807000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Resulting device map defaultdict(. at 0x7249ac6e0220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdk'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:31:48.807000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Removing multipathed devices sdk, sdj {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:31:48.807000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flush multipath device 3300000008471b24d {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:31:48.841124 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:48.844194 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Deleted allocations for instance 8925c8cc-b844-4697-9d32-99d9b39c394f Jul 05 03:31:48.877500 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:31:48.907222 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:48.928169 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:31:48.928558 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:31:48.930337 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:31:48.943316 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:31:48.943316 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:31:48.954783 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.002580 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:31:49.002580 np0000004562 nova-compute[99148]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:31:49.002580 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.002580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:49.003382 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:49.030878 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.042079 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.075308 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:31:49.075308 np0000004562 nova-compute[99148]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:31:49.075308 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.090323 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:49.091834 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:49.091834 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== disconnect_volume: return (327ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:49.091834 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:31:49.102025 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json -f qcow2" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:49.103279 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:49.114136 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:31:49.116486 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:49.117332 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:49.117506 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] Acquiring lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:49.117693 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:49.117878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:49.118021 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] No waiting events found dispatching network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:49.118134 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c9dcd031-0061-46d8-944e-9582d2952874 req-f10dc1d1-2b4e-4416-9043-231dea3ef120 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-unplugged-746e6639-5d12-4455-a62c-e72b29391501 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:31:49.200242 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:49.200670 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea.delta 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:49.251649 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea.delta 1073741824" returned: 0 in 0.050s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:49.251649 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Quiescing instance not available: QEMU guest agent is not enabled. Jul 05 03:31:49.305095 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:49.305602 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:49.476472 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-deleted-924b28f4-27f7-4a6b-aa53-667cdcec6779 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:49.476687 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Neutron deleted interface 924b28f4-27f7-4a6b-aa53-667cdcec6779; detaching it from the instance and deleting it from the info cache Jul 05 03:31:49.478819 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Detach interface failed, port_id=924b28f4-27f7-4a6b-aa53-667cdcec6779, reason: Instance 7f4104ac-fa7c-495a-9f64-c9b835bc6073 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:49.478970 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:49.479184 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:49.479352 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:49.479564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:49.479705 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:49.479869 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state resized and task_state resize_reverting. Jul 05 03:31:49.480001 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:49.480478 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:49.480616 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:49.480743 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:49.480880 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:31:49.481023 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-unplugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state resized and task_state resize_reverting. Jul 05 03:31:49.481163 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-deleted-86bf53df-be71-4602-af51-8fdc20c2874d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:49.481301 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Neutron deleted interface 86bf53df-be71-4602-af51-8fdc20c2874d; detaching it from the instance and deleting it from the info cache Jul 05 03:31:49.482635 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6c11bb96-7931-47a3-b806-6dda2b2edc0b req-5d511b71-e301-4092-b419-665eb6189ff4 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Detach interface failed, port_id=86bf53df-be71-4602-af51-8fdc20c2874d, reason: Instance 7f4104ac-fa7c-495a-9f64-c9b835bc6073 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:31:49.510077 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=99148) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 05 03:31:49.513139 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 05 03:31:49.548564 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:31:49.548877 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea.delta /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:49.667529 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea.delta /opt/stack/data/nova/instances/snapshots/tmp_kq85fk9/610405d14fdb42599881d321693a97ea" returned: 0 in 0.118s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:49.668060 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Snapshot extracted, beginning image upload Jul 05 03:31:49.811930 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:31:49.856307 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-dab81c21-83b7-4d46-98fe-6d33d035075d tempest-TestMultiAttachVolumeSwap-530722390 tempest-TestMultiAttachVolumeSwap-530722390-project-member] Lock "8925c8cc-b844-4697-9d32-99d9b39c394f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.972s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:50.078359 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:50.242274 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:50.242460 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:50.371637 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:50.406805 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d94f2cda-b777-4740-82d1-fb24ea4d4b97 req-b75c988a-23db-474c-8b3d-26c6cc125d29 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-deleted-7cb05efe-1c85-4dcc-afd2-7bc2a8f08e99 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:50.407019 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d94f2cda-b777-4740-82d1-fb24ea4d4b97 req-b75c988a-23db-474c-8b3d-26c6cc125d29 service nova] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Received event network-vif-deleted-21b31dbd-b19c-4bf9-9cf8-bf6e0a7c79c0 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:50.585177 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Took 3.82 seconds to deallocate network for instance. Jul 05 03:31:50.724205 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:50.745485 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'migration_context' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:50.754400 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004948780001541309 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:50.755180 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:50.755424 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:50.755576 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.525688367000157 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:50.755638 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.525589803999992 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:50.756218 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] VM Stopped (Lifecycle Event) Jul 05 03:31:51.247664 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Object Instance<56f86925-1417-4995-8ffe-d5c410bc7613> lazy-loaded attributes: resources,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:31:51.259209 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: ee8c5417-25e7-44b1-847c-6c989397ec07] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:51.362588 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:51.840508 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:51.840773 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:52.291310 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Took 1.70 seconds to detach 3 volumes for instance. Jul 05 03:31:52.345916 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:52.797654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:52.817459 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Snapshot image upload complete Jul 05 03:31:52.817567 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-71681d9e-2b3a-4d9b-a4a4-c9c2653367e1 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Took 5.58 seconds to snapshot the instance on the hypervisor. Jul 05 03:31:53.358065 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.115s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:53.358911 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.987s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:53.359194 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:31:53.367739 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:53.367929 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Claim successful on node np0000004562 Jul 05 03:31:53.743051 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:53.769993 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.770431 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.770630 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.770847 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.771043 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.771230 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.771559 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.771749 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:53.771855 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:31:53.772036 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:54.276109 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:54.609336 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:54.900042 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:54.965514 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Swapping old allocation on dict_keys(['555a8dfa-6105-4c91-843c-764798128d3b']) held by migration d0ca6070-b19e-44f8-b95a-66f3ab384f84 for instance Jul 05 03:31:54.972293 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:54.972293 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:55.058705 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Overwriting current allocation {'allocations': {'555a8dfa-6105-4c91-843c-764798128d3b': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 21}}, 'project_id': '026b2963073e4b6ca4fa964dbc89d833', 'user_id': '5f75c839862741bda4735a21795759ce', 'consumer_generation': 1} on consumer 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2035}} Jul 05 03:31:55.111200 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "37710fe2-332b-40f8-818f-777113757600" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:55.111488 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:55.143585 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:55.240532 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:55.240794 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquired lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:55.240957 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:55.476881 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:55.613905 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:31:55.745553 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:55.983300 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.625s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:55.983980 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.186s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:55.984166 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:31:56.185126 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:56.212862 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:56.345865 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:56.354440 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:56.363909 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:56.491867 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:31:56.492079 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:31:56.492244 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:56.492416 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:56.618655 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:56.619255 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:56.704425 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13eaeef1f2334d698ac49202f06873c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef60743c71546fc87af8540e17c0506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:31:56.856629 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Releasing lock "refresh_cache-56f86925-1417-4995-8ffe-d5c410bc7613" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:56.857334 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:56.868820 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:56.888573 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:56.922224 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:56.922615 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:56.933215 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:56.934910 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0'] Jul 05 03:31:56.936311 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:56.936311 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:56.936484 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:56.994484 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:31:57.122683 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:57.152618 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Successfully created port: f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:31:57.463669 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:57.498543 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:31:57.630911 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.647s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:57.632571 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.355s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:57.633154 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:57.633603 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.421s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:57.633918 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:31:57.638386 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:31:57.638514 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Claim successful on node np0000004562 Jul 05 03:31:57.717394 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Deleted allocations for instance 7f4104ac-fa7c-495a-9f64-c9b835bc6073 Jul 05 03:31:57.756216 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Successfully updated port: f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:31:57.831763 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Received event network-changed-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:31:57.831763 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Refreshing instance network info cache due to event network-changed-f30e0d74-c429-4833-b0b8-03272c833b15. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:31:57.831763 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] Acquiring lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:57.831763 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] Acquired lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:57.831912 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Refreshing network info cache for port f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:31:58.004780 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Booting with volume f6fd5b51-1395-4f24-8aaa-7d0fba465c1c at /dev/vda Jul 05 03:31:58.044431 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Starting finish_revert_migration {{(pid=99148) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13004}} Jul 05 03:31:58.053989 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:58.059628 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start _get_guest_xml network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '84e2f08a-4274-4505-8e1e-20c68c5938aa', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '56f86925-1417-4995-8ffe-d5c410bc7613', 'attached_at': '2026-07-05T03:31:57.000000', 'detached_at': '', 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'serial': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:31:58.061526 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:58.063371 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-677853189', uuid='56f86925-1417-4995-8ffe-d5c410bc7613'), owner=OwnerMeta(userid='5f75c839862741bda4735a21795759ce', username='tempest-ServerActionsTestOtherB-2067268672-project-member', projectid='026b2963073e4b6ca4fa964dbc89d833', projectname='tempest-ServerActionsTestOtherB-2067268672'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222318.0627887) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:31:58.066035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:31:58.066476 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:31:58.067015 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:31:58.067809 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:31:58.068073 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:31:58.069368 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:31:58.069657 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:31:58.069895 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:31:58.070588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:31:58.070588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:31:58.070588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:31:58.070588 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:31:58.070681 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:31:58.070888 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:31:58.071048 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:31:58.071207 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:31:58.071378 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:31:58.071603 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:31:58.089380 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:58.132002 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:31:58.132289 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:31:58.139135 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:31:58.140384 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0'] Jul 05 03:31:58.140595 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:31:58.140686 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:31:58.140996 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:31:58.141207 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Updating existing volume attachment record: a4cf4861-bea0-4de3-be9d-bd6bbf98bed1 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:31:58.263036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:31:58.281671 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00038845699987177795 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.281773 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.281899 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.0001659229999404488 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.282017 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003196589998424315 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.282077 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.282661 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.5519472290000067 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.282661 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.5518688130000555 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:31:58.283235 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:58.284456 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] VM Stopped (Lifecycle Event) Jul 05 03:31:58.286542 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:31:58.286730 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] VM Stopped (Lifecycle Event) Jul 05 03:31:58.335194 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:58.410634 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:58.568238 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:31:58.590530 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:58.689893 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:58.691239 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.config --force-share --output=json" returned: 0 in 0.101s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:58.703963 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:58.704329 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:31:58.731774 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0894b2cc-ba7e-464d-8731-f72a9b744961 tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Lock "7f4104ac-fa7c-495a-9f64-c9b835bc6073" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 15.582s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:58.734843 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "/opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.029s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:31:58.734843 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:31:58.737032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:31:58.737032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:58.739145 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:58.739145 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:31:58.749806 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:58.757079 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:58.757765 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:31:58.758969 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:58.758969 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:58.760858 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:31:58.760858 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:58.776153 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:58.776153 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:58.784624 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:31:58.784624 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:58.790250 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-758f8f45-9b32-41c2-bfe5-3051bb6ec0c5 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 8925c8cc-b844-4697-9d32-99d9b39c394f] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:58.793678 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-1048f6df-0dfe-4b01-bd39-ca2a3bff0bda tempest-VolumesAssistedSnapshotsTest-632308792 tempest-VolumesAssistedSnapshotsTest-632308792-project-member] [instance: a5af3d1a-6bd5-427a-90fd-2a464878e157] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:31:58.794796 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:58.802983 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2] added Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:58.804514 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:58.804984 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:58.805371 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:31:58.805903 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:58.806346 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0451(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:31:58.822779 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:58.823340 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:31:58.891792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:58.895215 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:58.976203 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:58.976403 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.070839 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-31678deb-627a-4646-a1b5-3c4ab2d46c0a req-7f4cd978-d3ec-4f27-b63d-9c4a0e807072 service nova] Releasing lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:31:59.071990 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:31:59.071990 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:31:59.076696 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.081551 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.176571 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.179729 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.267233 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.270365 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:31:59.274547 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.308907 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:31:59.309178 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:31:59.360557 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.360759 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.443044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.449255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.535384 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.536084 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.578487 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:31:59.632740 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.097s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.633684 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.674923 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:31:59.721731 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.722149 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.813770 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.817128 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:31:59.823687 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:31:59.826145 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:31:59.826145 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:31:59.831791 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:59.858025 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:31:59.863293 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.878675 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.879471 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.881385 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:31:59.881835 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=51120MB free_disk=74.34621810913086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:31:59.882058 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:31:59.893355 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.893355 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.893355 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:59.893555 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.893555 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.893555 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:59.899075 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.899075 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.899075 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:59.899230 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.899230 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.899230 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:59.928310 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:31:59.928310 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:31:59.928310 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.933317 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:31:59.937358 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:31:59.937358 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:31:59.937358 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.940984 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.951494 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:31:59.959648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.959648 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.959648 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.959648 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.959648 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:59.959853 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.959853 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.959853 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.959853 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.959853 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:59.960368 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:59.960568 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:59.961532 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('7', '-', '-', 0) found on session 23 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:59.961683 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:31:59.968700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:31:59.970576 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] HCTL ('8', '-', '-', 0) found on session 24 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:31:59.970576 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:31:59.986069 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 23 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:59.986069 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:31:59.993640 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Searching for a device in session 24 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:31:59.993898 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:00.136486 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Updating instance_info_cache with network_info: [{"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:00.317685 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:00.319737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:00.319737 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Creating image(s) Jul 05 03:32:00.319737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:32:00.319944 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Ensure instance console log exists: /opt/stack/data/nova/instances/5e2ef932-ebb3-4532-aa04-0c0a7602812a/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:00.320112 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:00.320345 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:00.320576 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:00.358752 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.722s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:00.358752 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:00.363461 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.481s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:00.639247 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-5e2ef932-ebb3-4532-aa04-0c0a7602812a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:00.639544 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Instance network_info: |[{"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:00.640451 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Start _get_guest_xml network_info=[{"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'a4cf4861-bea0-4de3-be9d-bd6bbf98bed1', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5e2ef932-ebb3-4532-aa04-0c0a7602812a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'serial': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'multiattach': True}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:00.642544 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:00.643784 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1040563781', uuid='5e2ef932-ebb3-4532-aa04-0c0a7602812a'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222320.6434247) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:00.645119 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:00.645766 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:00.646732 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:00.647072 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:00.648290 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:00.648594 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:00.648787 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:00.648934 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:00.649385 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:00.649385 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:00.649385 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:00.649385 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:00.649562 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:00.649681 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:00.650138 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:00.650138 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:00.664497 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:32:00.664960 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:00.665311 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:00.762267 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:32:00.834602 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004172599999492377 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:00.835040 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:00.835212 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:00.835386 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] VM Stopped (Lifecycle Event) Jul 05 03:32:00.836013 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.3333209760000955 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:00.836123 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.3331922570000643 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:00.885686 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:00.885925 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:00.886238 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:00.886506 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:00.953505 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87700afdc5b8465bb1fb235e2ebf6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3465ef2c67b48a5a9eeb4bea4ff9fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:01.090243 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:01.339551 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-f59bdb01-b72d-48fa-a024-8cfd999b9ce5 None None] [instance: 7f4104ac-fa7c-495a-9f64-c9b835bc6073] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:01.374247 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:01.389313 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance d22f1b3c-5d43-486e-a417-325d749fca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 79dcf4df-1d4d-462e-9b02-4bf431533787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 4d856996-148c-4732-9428-4f5611315969 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance a123d3ff-9f01-46b6-838c-11bc579124ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 56f86925-1417-4995-8ffe-d5c410bc7613 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 28b3c393-2575-4bb8-af24-988f514af885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 5e2ef932-ebb3-4532-aa04-0c0a7602812a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 37710fe2-332b-40f8-818f-777113757600 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:31:59 up 28 min, 2 users, load average: 8.41, 4.48, 2.10\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_c3465ef2c67b48a5a9eeb4bea4ff9fff': '4', 'io_workload': '2', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_026b2963073e4b6ca4fa964dbc89d833': '1', 'num_proj_e31f3215e6204f19859b8f62235b8cb7': '3', 'num_vm_rescued': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_4ef60743c71546fc87af8540e17c0506': '1'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Successfully created port: 77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Found WWN 3300000008471b24d for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-0', 'multipath_id': '3300000008471b24d'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008471b24d', 'path': '/dev/dm-0', 'multipath_id': '3300000008471b24d'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.117s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c] added Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:02.028620 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c] added Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:02.031923 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:02.053492 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:02.053575 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:02.293131 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:31:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:02.293339 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:02.294773 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] End _get_guest_xml xml= Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: instance-00000003 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-server-677853189 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 2026-07-05 03:31:58 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: True Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: bare Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: ide Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: pc Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672-project-member Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherB-2067268672 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: 63ed7b16-387c-4938-9d2e-0f4c344e1ee2 Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: Jul 05 03:32:02.299860 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Preparing to wait for external event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:31:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:02.303036 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:02.303548 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:02.304012 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.304277 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:02.304504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:02.305476 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.306061 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '378c4ad4-9eda-5c54-b6ef-0de45d9ad0aa', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:02.307336 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.307987 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:02.309704 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.311838 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.312012 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c91f432-9a, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:02.312418 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c91f432-9a, col_values=(('qos', UUID('31a7066f-5ddc-4edc-9c42-07bd30fdcea0')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:02.312535 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c91f432-9a, col_values=(('external_ids', {'iface-id': '8c91f432-9afa-42c0-95c5-81ebf116e5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:da:ea', 'vm-uuid': '56f86925-1417-4995-8ffe-d5c410bc7613'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:02.315319 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.316669 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:02.321000 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.329443 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.337199 np0000004562 nova-compute[99148]: INFO os_vif [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:32:02.361650 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.372052 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.404011 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Booting with volume-backed-image 0c8fa207-3de5-4489-a2c5-f4cc8559edb8 at /dev/vda Jul 05 03:32:02.557511 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:02.680414 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.682486 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.684364 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.685540 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.714008 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.716536 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Successfully updated port: 77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:02.775704 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-changed-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:02.775893 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Refreshing instance network info cache due to event network-changed-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:02.776074 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] Acquiring lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:02.776186 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] Acquired lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:02.776351 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Refreshing network info cache for port 77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:02.833827 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:02.837897 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:02.840537 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.850449 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:02.853334 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:02.856178 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.871405 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.884539 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.898149 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:02.906236 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.906236 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.906236 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.906236 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.906236 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:02.906384 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.906384 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.906384 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.906384 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.906384 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:02.935877 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:02.941068 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c, portal: 192.168.40.100,3260] Jul 05 03:32:02.941068 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c, portal: 192.168.40.100,3260] successful. Jul 05 03:32:02.941068 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.948586 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c, portal: 192.168.50.100,3260] Jul 05 03:32:02.948586 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c, portal: 192.168.50.100,3260] successful. Jul 05 03:32:02.948586 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.953926 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.960961 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.970247 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:02.970648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:02.970648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:02.972535 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('9', '-', '-', 0) found on session 25 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:02.972535 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.977985 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:02.978155 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:02.978416 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:02.978551 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:02.980013 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('10', '-', '-', 0) found on session 26 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:02.980231 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:02.992182 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 25 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:02.992182 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:03.009082 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: sde {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:03.009082 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:03.063412 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:32:03.063777 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.700s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:03.064305 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.61 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:03.169827 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00030363599989868817 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:03.169827 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:03.170463 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:03.170659 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Stopped (Lifecycle Event) Jul 05 03:32:03.219291 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:03.281928 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:03.384351 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:03.398856 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0ea1474c-233a-4bb6-86cf-25185053e6d3 req-e08f89cf-4dab-45af-be3e-ebe5c77abab6 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:03.400204 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0ea1474c-233a-4bb6-86cf-25185053e6d3 req-e08f89cf-4dab-45af-be3e-ebe5c77abab6 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:03.400379 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0ea1474c-233a-4bb6-86cf-25185053e6d3 req-e08f89cf-4dab-45af-be3e-ebe5c77abab6 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:03.400518 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0ea1474c-233a-4bb6-86cf-25185053e6d3 req-e08f89cf-4dab-45af-be3e-ebe5c77abab6 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:03.400668 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0ea1474c-233a-4bb6-86cf-25185053e6d3 req-e08f89cf-4dab-45af-be3e-ebe5c77abab6 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Processing event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:03.563922 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:03.673757 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:03.779819 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:03.780628 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:03.780628 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Started (Lifecycle Event) Jul 05 03:32:03.785858 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance running successfully. Jul 05 03:32:03.786324 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] finish_revert_migration finished successfully. {{(pid=99148) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13050}} Jul 05 03:32:03.802310 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:32:04.067621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-681e5a66-1bf4-402e-8e80-b7ebcfe21bb9 req-8e48015e-0366-43c6-a0ee-395c610be0bc service nova] Releasing lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:04.067621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:04.067621 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:04.284411 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:04.286575 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:04.646802 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:04.789012 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jul 05 03:32:04.789012 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:04.789112 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Paused (Lifecycle Event) Jul 05 03:32:04.818132 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 330000000e2708d9b for multipath device dm-1 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:32:04.818433 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:04.818601 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (4153ms) {'type': 'block', 'scsi_wwn': '330000000e2708d9b', 'path': '/dev/dm-1', 'multipath_id': '330000000e2708d9b'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:04.818753 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e2708d9b', 'path': '/dev/dm-1', 'multipath_id': '330000000e2708d9b'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:32:04.849943 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:04.865727 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-f93c7994-3293-48b2-8111-8422a9721cd5 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance to original state: 'active' Jul 05 03:32:04.968317 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.008890 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating instance_info_cache with network_info: [{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:05.291965 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:05.293285 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:05.293415 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Resumed (Lifecycle Event) Jul 05 03:32:05.329657 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1040563781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachvolumemultiattachtest-server-1040563781',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-j0da9q0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:58Z,user_data=None,user_id='13eaeef1f2334d698ac49202f06873c1',uuid=5e2ef932-ebb3-4532-aa04-0c0a7602812a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:05.329897 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:05.330397 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=f30e0d74-c429-4833-b0b8-03272c833b15,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf30e0d74-c4') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:05.330984 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e2ef932-ebb3-4532-aa04-0c0a7602812a {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:05.484281 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:05.484281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:05.484826 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:05.484997 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:05.485148 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] No waiting events found dispatching network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:05.485301 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-a03c4f6d-1bf6-4ad1-b8b0-9c2c98033c53 req-8e00c99e-603c-45af-8faa-9bdb98111410 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received unexpected event network-vif-plugged-8c91f432-9afa-42c0-95c5-81ebf116e5e9 for instance with vm_state active and task_state None. Jul 05 03:32:05.511186 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:05.512137 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance network_info: |[{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:05.651091 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.797102 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:05.797649 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] End _get_guest_xml xml= Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 5e2ef932-ebb3-4532-aa04-0c0a7602812a Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: instance-00000010 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-server-1040563781 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 2026-07-05 03:32:00 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: True Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 5e2ef932-ebb3-4532-aa04-0c0a7602812a Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 5e2ef932-ebb3-4532-aa04-0c0a7602812a Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: Jul 05 03:32:05.837178 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:05.839124 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Preparing to wait for external event network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:05.839124 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:05.839124 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:05.839124 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:05.839124 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1040563781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachvolumemultiattachtest-server-1040563781',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-j0da9q0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:58Z,user_data=None,user_id='13eaeef1f2334d698ac49202f06873c1',uuid=5e2ef932-ebb3-4532-aa04-0c0a7602812a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:05.841831 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "f30e0d74-c429-4833-b0b8-03272c833b15", "address": "fa:16:3e:85:32:0d", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf30e0d74-c4", "ovs_interfaceid": "f30e0d74-c429-4833-b0b8-03272c833b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:05.842432 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=f30e0d74-c429-4833-b0b8-03272c833b15,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf30e0d74-c4') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:05.842768 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=f30e0d74-c429-4833-b0b8-03272c833b15,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf30e0d74-c4') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:05.843029 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.843234 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:05.843437 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:05.844138 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.844305 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '186e820d-e9a8-5069-a286-3fcd02dc21f4', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:05.845961 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.847179 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:05.851624 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.851767 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf30e0d74-c4, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:05.852097 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf30e0d74-c4, col_values=(('qos', UUID('067d9a8e-9180-4d62-a306-4162316243a5')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:05.852281 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf30e0d74-c4, col_values=(('external_ids', {'iface-id': 'f30e0d74-c429-4833-b0b8-03272c833b15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:32:0d', 'vm-uuid': '5e2ef932-ebb3-4532-aa04-0c0a7602812a'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:05.853110 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.854830 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:05.858868 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.865129 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.869619 np0000004562 nova-compute[99148]: INFO os_vif [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=f30e0d74-c429-4833-b0b8-03272c833b15,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf30e0d74-c4') Jul 05 03:32:05.900961 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:05.906916 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.063737 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:06.077142 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:32:06.107744 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:06.152067 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:32:06.155607 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:32:06.165742 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:32:06.167212 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0', 'fe80::f816:3eff:fe0f:daea', 'fe80::f84d:a0ff:fe54:b327', 'fe80::3847:67ff:fe92:197'] Jul 05 03:32:06.167557 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:32:06.167868 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:32:06.168292 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:06.168732 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating existing volume attachment record: 158c93f6-83c3-42c8-bd90-74ba6df4195c {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:32:06.215389 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.217301 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.224046 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.228409 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.252005 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.272148 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0341a08a-cdea-464e-bfd9-306d29b317c4 req-240a3eb7-4bce-4d8c-a690-6c615b11df86 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Received event network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:06.272406 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0341a08a-cdea-464e-bfd9-306d29b317c4 req-240a3eb7-4bce-4d8c-a690-6c615b11df86 service nova] Acquiring lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:06.273232 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0341a08a-cdea-464e-bfd9-306d29b317c4 req-240a3eb7-4bce-4d8c-a690-6c615b11df86 service nova] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:06.273232 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0341a08a-cdea-464e-bfd9-306d29b317c4 req-240a3eb7-4bce-4d8c-a690-6c615b11df86 service nova] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:06.273232 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0341a08a-cdea-464e-bfd9-306d29b317c4 req-240a3eb7-4bce-4d8c-a690-6c615b11df86 service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Processing event network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:06.374006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:06.681537 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:06.681678 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:06.681862 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:06.681978 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:06.682075 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:06.685474 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Terminating instance Jul 05 03:32:07.188563 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:32:07.230550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:07.238967 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:07.398624 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:07.399080 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:07.399080 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:85:32:0d, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:07.399289 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Using config drive Jul 05 03:32:07.523905 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999617408999939 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:07.525517 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997931837999886 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:07.525670 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997784253999953 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:07.527097 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Instance destroyed successfully. Jul 05 03:32:07.527459 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lazy-loading 'resources' on Instance uuid 56f86925-1417-4995-8ffe-d5c410bc7613 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:07.834740 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:07.910366 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:08.038620 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Creating config drive at /opt/stack/data/nova/instances/5e2ef932-ebb3-4532-aa04-0c0a7602812a/disk.config Jul 05 03:32:08.038620 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-677853189',display_name='tempest-ServerActionsTestOtherB-server-677853189',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestotherb-server-677853189',id=3,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXYyUrxXrtH95Q4BeDHcensVZto0HXqrFurkYv/Wbkz0S1ywztybHMTA/fMYV+IgXtYLB9B7AG5NWi0zUcylM8GrX7V2/hgx6+2nylk1E9u/h+sQF2ZhKncjSUaJPZYOQ==',key_name='tempest-keypair-413497296',keypairs=,launch_index=0,launched_at=2026-07-05T03:32:04Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='026b2963073e4b6ca4fa964dbc89d833',ramdisk_id='',reservation_id='r-7lmt9eto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2067268672',owner_user_name='tempest-ServerActionsTestOtherB-2067268672-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:32:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f75c839862741bda4735a21795759ce',uuid=56f86925-1417-4995-8ffe-d5c410bc7613,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:32:08.038620 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converting VIF {"id": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "address": "fa:16:3e:0f:da:ea", "network": {"id": "c6524f46-5b50-4200-ad65-c55ba3863efd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117931664-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "026b2963073e4b6ca4fa964dbc89d833", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c91f432-9a", "ovs_interfaceid": "8c91f432-9afa-42c0-95c5-81ebf116e5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:08.038620 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:08.038620 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:32:08.044801 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e2ef932-ebb3-4532-aa04-0c0a7602812a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbla8zofu {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:08.064739 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.068051 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.088607 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.088927 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c91f432-9a, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:08.092972 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.092972 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:08.094456 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.094456 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.095084 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.096829 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31a7066f-5ddc-4edc-9c42-07bd30fdcea0) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:08.096829 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.096829 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:08.097159 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.104791 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e2ef932-ebb3-4532-aa04-0c0a7602812a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbla8zofu" returned: 0 in 0.060s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:08.105363 np0000004562 nova-compute[99148]: INFO os_vif [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:ea,bridge_name='br-int',has_traffic_filtering=True,id=8c91f432-9afa-42c0-95c5-81ebf116e5e9,network=Network(c6524f46-5b50-4200-ad65-c55ba3863efd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c91f432-9a') Jul 05 03:32:08.106832 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.110840 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:32:08.110840 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:08.110840 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:08.110840 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:08.111305 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:32:08.111437 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:32:08.134484 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2 (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:08.142465 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:08.143004 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:32:08.143004 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '23')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:08.143721 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2', '24')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:08.144469 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Resulting device map defaultdict(. at 0x7249ac67f7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:32:08.144642 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:32:08.146358 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Flush multipath device 3300000008471b24d {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:32:08.186003 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:08.239213 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:08.293300 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:32:08.293519 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:32:08.294503 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:32:08.307436 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:08.309379 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:32:08.309623 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:32:08.310038 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:08.310313 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Creating image(s) Jul 05 03:32:08.310678 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:32:08.310907 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Ensure instance console log exists: /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:08.311084 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:08.311345 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:08.311491 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:08.312118 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start _get_guest_xml network_info=[{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '158c93f6-83c3-42c8-bd90-74ba6df4195c', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '37710fe2-332b-40f8-818f-777113757600', 'attached_at': '', 'detached_at': '', 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'serial': '614876c0-4fe6-4f48-9a0c-c593830cf43b'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:08.316945 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:08.318431 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105', uuid='37710fe2-332b-40f8-818f-777113757600'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222328.317908) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:08.319405 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:08.319783 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:08.320674 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:08.320904 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:08.321951 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:08.322487 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:08.322813 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:08.322961 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:08.323473 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.323724 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:08.323923 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:08.324522 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:08.324845 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:08.325017 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:08.325146 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:08.325262 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:08.325386 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:08.338581 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:32:08.338931 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:08.339109 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:08.342227 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Received event network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:08.342505 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] Acquiring lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:08.342765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:08.342940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:08.343222 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] No waiting events found dispatching network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:08.343320 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-bbaaab17-42f4-4f20-bc8b-9e988f69eb48 req-8bc96a33-ea0c-46ba-b773-ea81c32743ff service nova] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Received unexpected event network-vif-plugged-f30e0d74-c429-4833-b0b8-03272c833b15 for instance with vm_state building and task_state spawning. Jul 05 03:32:08.355232 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] Jul 05 03:32:08.355232 np0000004562 nova-compute[99148]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.40.100,3260] successful. Jul 05 03:32:08.355232 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.370601 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.384739 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.408131 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] Jul 05 03:32:08.408131 np0000004562 nova-compute[99148]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-63ed7b16-387c-4938-9d2e-0f4c344e1ee2, portal: 192.168.50.100,3260] successful. Jul 05 03:32:08.408131 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.421586 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.421811 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:08.421961 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] <== disconnect_volume: return (312ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:08.422071 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:32:08.422465 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Deleting instance files /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_del Jul 05 03:32:08.422863 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.084s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:08.423251 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:08.428276 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Deletion of /opt/stack/data/nova/instances/56f86925-1417-4995-8ffe-d5c410bc7613_del complete Jul 05 03:32:08.434357 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:08.435058 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:08.435681 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:08.435791 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:08.436202 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:08.436396 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:08.447364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:08.447364 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.453656 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:08.453656 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b] added Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:08.461208 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b] added Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:08.465513 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:08.465648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:08.465804 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:08.465978 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:08.574940 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.582075 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:08.938322 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Took 1.75 seconds to destroy the instance on the hypervisor. Jul 05 03:32:08.938963 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:32:08.939342 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:32:08.939489 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:32:08.939877 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:08.972622 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:09.031776 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:09.461147 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:09.463103 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:09.466366 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:09.477935 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:09.489654 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.499062 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.505288 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.513622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.513622 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.513622 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.513622 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.513622 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:09.513839 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.513839 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.513839 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.513839 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.513839 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:09.525043 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.525043 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.525043 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.525043 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.525043 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:09.525669 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.525669 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.525669 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.525669 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.525669 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:09.559872 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.40.100,3260] Jul 05 03:32:09.559872 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.40.100,3260] successful. Jul 05 03:32:09.559872 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.563505 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:09.564063 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:09.564301 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] VM Started (Lifecycle Event) Jul 05 03:32:09.566460 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:09.569462 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Instance spawned successfully. Jul 05 03:32:09.569462 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:09.575108 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.50.100,3260] Jul 05 03:32:09.575108 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.50.100,3260] successful. Jul 05 03:32:09.575108 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.581867 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.586202 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-46c7b308-762b-4e5c-8cb8-881d5313ed4d req-221df9a5-c549-4a25-9b4d-7fe22c570c50 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Received event network-vif-deleted-8c91f432-9afa-42c0-95c5-81ebf116e5e9 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:09.586330 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-46c7b308-762b-4e5c-8cb8-881d5313ed4d req-221df9a5-c549-4a25-9b4d-7fe22c570c50 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Neutron deleted interface 8c91f432-9afa-42c0-95c5-81ebf116e5e9; detaching it from the instance and deleting it from the info cache Jul 05 03:32:09.587975 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-46c7b308-762b-4e5c-8cb8-881d5313ed4d req-221df9a5-c549-4a25-9b4d-7fe22c570c50 service nova] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Detach interface failed, port_id=8c91f432-9afa-42c0-95c5-81ebf116e5e9, reason: Instance 56f86925-1417-4995-8ffe-d5c410bc7613 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:32:09.588346 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.598284 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.598473 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:09.598752 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:09.598913 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:09.599621 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('7', '-', '-', 0) found on session 27 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:09.599727 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:09.609366 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:09.610083 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:09.610083 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:09.610604 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('8', '-', '-', 0) found on session 28 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:09.610604 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:09.618727 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 27 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:09.619012 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:09.631730 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 28 and hctl ['8', '*', '*', 0] yield: None {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:10.021407 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:10.069534 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:10.072908 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:10.075562 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.075687 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.075984 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.076171 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.076370 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.076573 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:10.524450 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Took 1.58 seconds to deallocate network for instance. Jul 05 03:32:10.576129 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:32:10.576260 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:10.576901 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] VM Paused (Lifecycle Event) Jul 05 03:32:10.585084 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Took 10.27 seconds to spawn the instance on the hypervisor. Jul 05 03:32:10.585269 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:10.626378 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 28 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:10.626574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:11.079327 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:11.082245 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:11.082245 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] VM Resumed (Lifecycle Event) Jul 05 03:32:11.092547 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Took 0.57 seconds to detach 1 volumes for instance. Jul 05 03:32:11.103951 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Took 20.79 seconds to build instance. Jul 05 03:32:11.376887 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:11.452128 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Found WWN 3300000003ab19181 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:32:11.453209 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:11.453209 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== connect_volume: return (3114ms) {'type': 'block', 'scsi_wwn': '3300000003ab19181', 'path': '/dev/dm-0', 'multipath_id': '3300000003ab19181'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:11.453209 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003ab19181', 'path': '/dev/dm-0', 'multipath_id': '3300000003ab19181'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:32:11.585541 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:11.587365 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 5e2ef932-ebb3-4532-aa04-0c0a7602812a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:11.600777 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:11.600966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:11.606877 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-503827aa-83b1-42c5-86cc-dd995f3bdaf8 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "5e2ef932-ebb3-4532-aa04-0c0a7602812a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.301s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:11.872044 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:11.959239 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-586913105',id=17,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-jb0b6koh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:02Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=37710fe2-332b-40f8-818f-777113757600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:11.961601 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:11.962448 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:11.963085 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:12.170848 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:12.171199 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] End _get_guest_xml xml= Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: instance-00000011 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-586913105 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 2026-07-05 03:32:08 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: True Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: bare Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: 614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: Jul 05 03:32:12.469313 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Preparing to wait for external event network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-586913105',id=17,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-jb0b6koh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:02Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=37710fe2-332b-40f8-818f-777113757600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:12.471577 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:12.472395 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.472395 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:12.472530 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:12.473565 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.474078 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e750d040-d044-5fb6-91b1-35aea9b31e35', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:12.475677 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.475677 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:12.477195 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.479254 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.479394 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77cc4cdb-f6, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:12.479884 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77cc4cdb-f6, col_values=(('qos', UUID('bcb94993-60a6-4867-9570-d0a5de39b77a')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:12.479977 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77cc4cdb-f6, col_values=(('external_ids', {'iface-id': '77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:5e:2f', 'vm-uuid': '37710fe2-332b-40f8-818f-777113757600'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:12.481400 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.483764 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:12.488575 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.497791 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.498104 np0000004562 nova-compute[99148]: INFO os_vif [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') Jul 05 03:32:12.535644 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.537286 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.665266 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:12.674255 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:12.755901 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e8c91803-45ff-4591-b213-22ef57e395ba req-084b7dbb-5f32-45bf-a2c1-9274c3e5152b service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:12.756156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e8c91803-45ff-4591-b213-22ef57e395ba req-084b7dbb-5f32-45bf-a2c1-9274c3e5152b service nova] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:12.756341 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e8c91803-45ff-4591-b213-22ef57e395ba req-084b7dbb-5f32-45bf-a2c1-9274c3e5152b service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:12.756487 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e8c91803-45ff-4591-b213-22ef57e395ba req-084b7dbb-5f32-45bf-a2c1-9274c3e5152b service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:12.757035 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e8c91803-45ff-4591-b213-22ef57e395ba req-084b7dbb-5f32-45bf-a2c1-9274c3e5152b service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Processing event network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:13.183541 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.582s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:13.253893 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Deleted allocations for instance 56f86925-1417-4995-8ffe-d5c410bc7613 Jul 05 03:32:14.028573 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:14.029167 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:14.029167 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:58:5e:2f, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:14.029364 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Using config drive Jul 05 03:32:14.263526 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2851cfc2-0ee7-44a5-9d0e-f8c657130272 tempest-ServerActionsTestOtherB-2067268672 tempest-ServerActionsTestOtherB-2067268672-project-member] Lock "56f86925-1417-4995-8ffe-d5c410bc7613" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.582s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:14.387805 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:14.535075 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:14.719765 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Creating config drive at /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config Jul 05 03:32:14.725516 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyo6bu4pq {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:14.790254 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyo6bu4pq" returned: 0 in 0.064s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:14.833868 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:14.834677 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:14.834677 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:14.834677 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:14.834677 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] No waiting events found dispatching network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:14.834677 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-54afbb35-c760-4831-8ea2-e95e2849b5e6 req-8bf85165-4229-4647-9cc1-45060aa8172c service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received unexpected event network-vif-plugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df for instance with vm_state building and task_state spawning. Jul 05 03:32:15.065525 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:15.065525 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:15.248551 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:15.256417 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:15.559741 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:32:16.133492 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:16.135430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:16.141876 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:32:16.142163 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Claim successful on node np0000004562 Jul 05 03:32:16.291477 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:16.292819 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:16.293106 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Started (Lifecycle Event) Jul 05 03:32:16.296262 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:16.299064 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance spawned successfully. Jul 05 03:32:16.299663 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:16.377206 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:16.727480 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:16.797358 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:16.801382 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:16.808775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:16.808978 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:16.809340 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:16.809620 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:16.809995 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:16.810269 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:17.305264 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:32:17.305746 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:17.305746 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Paused (Lifecycle Event) Jul 05 03:32:17.318973 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Took 9.01 seconds to spawn the instance on the hypervisor. Jul 05 03:32:17.318973 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:17.379573 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:17.481651 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:17.713448 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:17.713727 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:17.808679 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:17.812284 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:17.812641 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Resumed (Lifecycle Event) Jul 05 03:32:17.834224 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Took 21.71 seconds to build instance. Jul 05 03:32:18.216456 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:18.315020 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:18.316696 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:18.335808 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.224s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:18.729275 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.595s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:18.729847 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:19.148002 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:19.237399 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:19.238153 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:19.238504 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:19.238800 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:19.266385 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:19.344328 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13eaeef1f2334d698ac49202f06873c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef60743c71546fc87af8540e17c0506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:19.403426 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:19.403679 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:19.742998 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:19.907902 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'flavor' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:20.043812 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Successfully created port: 8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:20.249414 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:20.333247 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Rescuing Jul 05 03:32:20.333562 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:20.333799 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:20.333977 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:20.754310 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Successfully updated port: 8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:20.830063 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:20.830245 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing instance network info cache due to event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:20.830350 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] Acquiring lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:20.830425 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] Acquired lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:20.830523 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing network info cache for port 8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:20.836573 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:20.913816 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:21.060290 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "25e1371d-6866-4ebb-a546-610aadd4e70e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:21.062197 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:21.233780 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:21.261533 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:21.263102 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:21.264247 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:21.264556 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Creating image(s) Jul 05 03:32:21.266495 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "/opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:21.266798 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:21.267554 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:21.268543 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:21.273509 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:21.277606 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:21.335656 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:21.380742 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:21.395836 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.118s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:21.396203 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:21.396607 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:21.397141 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:21.400070 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:21.400371 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:21.422158 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating instance_info_cache with network_info: [{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:21.429053 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:21.515280 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.115s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:21.516364 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:21.565467 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:32:21.576905 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk 1073741824" returned: 0 in 0.060s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:21.580735 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.181s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:21.580735 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:21.676990 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:21.677741 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:32:21.680733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:21.700309 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:21.791055 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Cannot resize image /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Ensure instance console log exists: /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:21.793580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:21.934692 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:22.053304 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:22.053918 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:22.053918 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attaching volume edafe60a-44d7-43ef-983e-c5e6a199b431 to /dev/vdb Jul 05 03:32:22.092896 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:22.107382 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:32:22.124510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:22.124841 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:22.131075 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:32:22.131584 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Claim successful on node np0000004562 Jul 05 03:32:22.134346 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:22.166067 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:32:22.166456 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:32:22.175640 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:32:22.176913 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe58:5e2f'] Jul 05 03:32:22.177000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:32:22.177100 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:32:22.177316 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:22.177552 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating existing volume attachment record: 69c0982d-db66-4428-82b5-9e5904f8943a {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:32:22.204891 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2b451eba-f10a-49f1-b4d3-02cd92a5bd98 req-6186e597-c10c-43d4-acea-8d356c80378e service nova] Releasing lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:22.205401 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:22.206801 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:22.484214 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:22.524354 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005161310000403319 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:22.524354 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:22.524575 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:22.524766 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] VM Stopped (Lifecycle Event) Jul 05 03:32:22.739623 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:32:22.740092 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:22.740289 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:22.740845 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:22.741143 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:22.758482 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:22.759246 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:22.759946 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:22.760213 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:22.761010 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:22.761307 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:22.774343 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:22.774343 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:22.777084 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:22.780438 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:22.780438 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431] added Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:22.787396 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:22.787628 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:22.790739 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:22.790739 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431] added Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:22.793257 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:22.793874 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:22.793874 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:22.793874 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:22.947280 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:23.033044 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-43963cf4-1aa8-420e-a8ee-59455e72bc04 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 56f86925-1417-4995-8ffe-d5c410bc7613] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:23.123419 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updating instance_info_cache with network_info: [{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:23.225507 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:23.549728 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:23.557324 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:23.625703 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:23.626129 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Instance network_info: |[{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:23.629116 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Start _get_guest_xml network_info=[{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:23.631754 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:23.632769 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='134dd22e-099b-4049-b8c3-8bbd75028bdf'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222343.632337) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:23.634184 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:23.634608 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:23.640037 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:23.641400 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:23.642990 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:23.643153 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:23.643342 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:23.643406 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:23.644005 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:23.644005 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:23.644005 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:23.644275 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:23.644275 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:23.644275 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:23.644275 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:23.644764 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:23.658924 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=18,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-9cfsijov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=134dd22e-099b-4049-b8c3-8bbd75028bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:23.659138 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:23.659619 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=8052749e-94cf-4dc9-adc7-2435fc10905e,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8052749e-94') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:23.660223 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'pci_devices' on Instance uuid 134dd22e-099b-4049-b8c3-8bbd75028bdf {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:23.702650 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:23.702650 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:23.788462 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:23.795130 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:23.799691 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:23.811112 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:23.814797 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.825219 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.830763 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.841612 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.842012 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.856067 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.856440 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:23.864121 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999713798999892 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:23.864268 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996163542999966 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:23.865100 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.995916354999963 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:23.869129 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance destroyed successfully. Jul 05 03:32:23.869849 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'numa_topology' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:23.891388 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.50.100,3260] Jul 05 03:32:23.891388 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.50.100,3260] successful. Jul 05 03:32:23.891388 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.906911 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.40.100,3260] Jul 05 03:32:23.906911 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.40.100,3260] successful. Jul 05 03:32:23.906911 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.916488 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.927755 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.942532 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.943005 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:23.943176 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:23.943271 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:23.944495 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:23.944634 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.956241 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:23.956705 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:23.957332 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:23.958469 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:23.958880 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:23.970978 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:23.970978 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:23.984937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:23.985400 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] End _get_guest_xml xml= Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 134dd22e-099b-4049-b8c3-8bbd75028bdf Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: instance-00000012 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: multiattach-server-0 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 2026-07-05 03:32:23 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: True Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: bare Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 134dd22e-099b-4049-b8c3-8bbd75028bdf Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 134dd22e-099b-4049-b8c3-8bbd75028bdf Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Preparing to wait for external event network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:24.164024 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:24.166260 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:24.166260 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:24.166260 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=18,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-9cfsijov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=134dd22e-099b-4049-b8c3-8bbd75028bdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:24.166260 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:24.166260 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=8052749e-94cf-4dc9-adc7-2435fc10905e,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8052749e-94') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:24.166536 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=8052749e-94cf-4dc9-adc7-2435fc10905e,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8052749e-94') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:24.166578 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.167407 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:24.167668 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:24.168514 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.168668 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eae6ff84-4533-5658-ab87-9cb7ac6f891c', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:24.169651 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.170276 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:24.171368 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.173759 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.174024 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8052749e-94, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:24.174383 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8052749e-94, col_values=(('qos', UUID('ade88026-5067-4e84-9089-4f3c5542cb02')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:24.174570 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8052749e-94, col_values=(('external_ids', {'iface-id': '8052749e-94cf-4dc9-adc7-2435fc10905e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0b:53', 'vm-uuid': '134dd22e-099b-4049-b8c3-8bbd75028bdf'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:24.177060 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.178763 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:24.183062 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.189213 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.200430 np0000004562 nova-compute[99148]: INFO os_vif [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=8052749e-94cf-4dc9-adc7-2435fc10905e,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8052749e-94') Jul 05 03:32:24.206615 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:24.220352 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.226308 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.364175 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.365786 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:24.375027 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Attempting a stable device rescue Jul 05 03:32:24.491740 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:32:24.496291 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:32:24.496523 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Creating image(s) Jul 05 03:32:24.497102 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:24.497229 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:24.498311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:24.498472 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:24.719490 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.595s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:24.723746 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:24.760822 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:32:25.000401 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:25.000856 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "c47d55da47a16165e6ece5076981c1519f3322cd" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:25.001025 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c47d55da47a16165e6ece5076981c1519f3322cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:25.214973 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:25.236290 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:25.238740 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:25.238740 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:25.238740 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:25.442011 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eddbc1b720fd44d0b36e9f9759161a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe307c595da542e184ffe93fcfd11d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:25.697889 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:25.701566 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:25.702226 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:25.741230 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:25.747324 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:25.747525 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:25.747653 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:19:0b:53, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:25.748250 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Using config drive Jul 05 03:32:25.790289 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Found WWN 330000000a2ed4bb7 for multipath device dm-7 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:32:25.790699 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:25.790848 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000a2ed4bb7', 'path': '/dev/dm-7', 'multipath_id': '330000000a2ed4bb7'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:25.791493 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a2ed4bb7', 'path': '/dev/dm-7', 'multipath_id': '330000000a2ed4bb7'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:32:25.799427 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'flavor' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:25.802443 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.part --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:25.802443 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] 2ed4c9cd-2108-4e49-aed4-96887a758239 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:32:25.803685 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:32:25.803685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.part /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:25.840550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:25.892158 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.part /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.converted" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:25.897729 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:25.980733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd.converted --force-share --output=json" returned: 0 in 0.083s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:25.981570 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c47d55da47a16165e6ece5076981c1519f3322cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.980s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:25.982190 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:25.991289 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Successfully created port: fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:26.000020 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:26.001528 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "c47d55da47a16165e6ece5076981c1519f3322cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:26.004741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c47d55da47a16165e6ece5076981c1519f3322cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:26.004741 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:26.006525 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:26.006945 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:26.096875 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:26.100347 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd,backing_fmt=raw /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:26.142452 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c47d55da47a16165e6ece5076981c1519f3322cd,backing_fmt=raw /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.rescue" returned: 0 in 0.045s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:26.144333 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "c47d55da47a16165e6ece5076981c1519f3322cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:26.144333 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'migration_context' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:26.246205 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:26.254736 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:26.304240 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attempting to attach volume edafe60a-44d7-43ef-983e-c5e6a199b431 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] attach device xml: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: Jul 05 03:32:26.306061 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:32:26.381941 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:26.398942 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Creating config drive at /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.config Jul 05 03:32:26.403964 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpprjem0zm {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:26.449357 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpprjem0zm" returned: 0 in 0.045s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:26.610121 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Successfully updated port: fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:26.647539 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:26.647877 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:26.648527 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start _get_guest_xml network_info=[{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:58:5e:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '2ed4c9cd-2108-4e49-aed4-96887a758239', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '158c93f6-83c3-42c8-bd90-74ba6df4195c', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '37710fe2-332b-40f8-818f-777113757600', 'attached_at': '', 'detached_at': '', 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'serial': '614876c0-4fe6-4f48-9a0c-c593830cf43b'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:26.648704 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:26.681119 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Received event network-changed-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:26.681119 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Refreshing instance network info cache due to event network-changed-fb492196-c5fa-4287-907a-95b1098b4126. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:26.681558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] Acquiring lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:26.681558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] Acquired lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:26.681558 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Refreshing network info cache for port fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:26.965694 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:26.978014 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:27.115120 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:27.152753 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:27.161321 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:27.161550 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105', uuid='37710fe2-332b-40f8-818f-777113757600'), owner=OwnerMeta(userid='87700afdc5b8465bb1fb235e2ebf6717', username='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member', projectid='c3465ef2c67b48a5a9eeb4bea4ff9fff', projectname='tempest-ServerBootFromVolumeStableRescueTest-2049298576'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:58:5e:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222347.1611767) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:27.168137 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:27.168600 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:27.171321 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:27.171512 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:27.172439 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:27.172733 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:27.172898 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:27.172956 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:27.173069 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:27.173148 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:27.173247 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:27.173348 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:27.173445 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:27.173544 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:27.173653 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:27.173763 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:27.173895 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:27.186018 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:27.264035 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:27.265027 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:27.265266 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Creating image(s) Jul 05 03:32:27.266021 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "/opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:27.266229 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:27.266870 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:27.267665 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:27.270955 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:27.272338 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.275606 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:27.376745 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.104s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.377252 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:27.377735 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:27.378327 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:27.383582 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:27.383970 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.479637 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:27.487102 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.103s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.487553 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.538457 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk 1073741824" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.539036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:27.539385 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.629487 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.630079 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:32:27.630391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.677459 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:27.691702 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:27.723863 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.724684 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Cannot resize image /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:32:27.725047 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:27.725305 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Ensure instance console log exists: /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:27.725618 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:27.725936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:27.726398 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:27.799249 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config --force-share --output=json" returned: 0 in 0.108s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "/opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:27.801966 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:27.856540 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:27.856881 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] VM Started (Lifecycle Event) Jul 05 03:32:27.982699 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c1e687a5-4687-409f-a975-d9968bbb5aaa req-6acf65f9-487e-40e3-afa3-568cd97ccd0a service nova] Releasing lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:27.983218 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquired lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:27.983436 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:28.003362 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:28.003475 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:28.003592 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:28.003685 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:73:41:ed, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:28.083301 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.282s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:28.083301 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:28.100947 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:28.101513 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:28.102137 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:28.102380 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:28.103214 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:28.103214 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:32:28.124618 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:28.133575 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:28.141869 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:28.151622 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:28.152001 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:28.152210 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:28.152288 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:28.153164 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('8', '0', '0', 0) found on session 28 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:28.153301 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:28.161736 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:28.162203 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:28.162453 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:28.163021 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] HCTL ('7', '0', '0', 0) found on session 27 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:28.163197 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:28.169464 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 28 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:28.169682 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:28.172117 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Searching for a device in session 27 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:28.172662 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:28.359826 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:28.361440 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:28.361568 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] VM Paused (Lifecycle Event) Jul 05 03:32:28.572895 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:28.765532 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:28.806286 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:28.863830 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:28.867943 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:28.953621 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Updating instance_info_cache with network_info: [{"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:29.102894 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:32:29.184296 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:29.370543 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:32:29.457664 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Releasing lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:29.457664 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Instance network_info: |[{"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:29.461123 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Start _get_guest_xml network_info=[{"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:29.465412 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:29.472532 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-58532224', uuid='25e1371d-6866-4ebb-a546-610aadd4e70e'), owner=OwnerMeta(userid='eddbc1b720fd44d0b36e9f9759161a98', username='tempest-ServerActionsTestOtherA-1550935099-project-member', projectid='fe307c595da542e184ffe93fcfd11d4c', projectname='tempest-ServerActionsTestOtherA-1550935099'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222349.4705377) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:29.476059 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:29.476440 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:29.477198 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:29.477382 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:29.478446 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:29.478891 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:29.479079 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:29.479204 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:29.479352 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:29.479460 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:29.479594 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:29.479778 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:29.479937 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:29.480037 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:29.480139 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:29.480278 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:29.497934 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-58532224',display_name='tempest-ServerActionsTestOtherA-server-58532224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestothera-server-58532224',id=19,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwyIxctZF/uJtFF3wvzH8B+ZHrahStFY/gqzkBr1FnRkjNCHmwNEhyHYPSsJf/TiOEVsTds3f2K+AJDGkp5M6egv/O5p7M2LpH9RIZpgH+HWFYyAoSpMNRebEFRTXTdNQ==',key_name='tempest-keypair-1576056450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-866axt5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=25e1371d-6866-4ebb-a546-610aadd4e70e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:29.498514 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:29.498654 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=fb492196-c5fa-4287-907a-95b1098b4126,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb492196-c5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:29.499491 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'pci_devices' on Instance uuid 25e1371d-6866-4ebb-a546-610aadd4e70e {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:29.560560 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-029da731-8b85-40dd-b7dd-2848bd9fd04f tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.507s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:29.617493 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:29.617734 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:29.999966 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Rescuing Jul 05 03:32:30.000134 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:30.000265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:30.000418 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] End _get_guest_xml xml= Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 25e1371d-6866-4ebb-a546-610aadd4e70e Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: instance-00000013 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-server-58532224 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 2026-07-05 03:32:29 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: True Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: bare Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099-project-member Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 25e1371d-6866-4ebb-a546-610aadd4e70e Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 25e1371d-6866-4ebb-a546-610aadd4e70e Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: Jul 05 03:32:30.002733 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Preparing to wait for external event network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-58532224',display_name='tempest-ServerActionsTestOtherA-server-58532224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serveractionstestothera-server-58532224',id=19,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwyIxctZF/uJtFF3wvzH8B+ZHrahStFY/gqzkBr1FnRkjNCHmwNEhyHYPSsJf/TiOEVsTds3f2K+AJDGkp5M6egv/O5p7M2LpH9RIZpgH+HWFYyAoSpMNRebEFRTXTdNQ==',key_name='tempest-keypair-1576056450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-866axt5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=25e1371d-6866-4ebb-a546-610aadd4e70e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:30.005749 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=fb492196-c5fa-4287-907a-95b1098b4126,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb492196-c5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:30.006162 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=fb492196-c5fa-4287-907a-95b1098b4126,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb492196-c5') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:30.006482 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.006738 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:30.007021 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:30.008256 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.008458 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c1128a6-0e81-5cda-895c-fa00d6300ef2', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:30.009270 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.010059 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:30.010550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.013426 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.013591 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb492196-c5, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:30.014006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb492196-c5, col_values=(('qos', UUID('8ae0f484-0343-4139-a342-38ef34c42c23')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:30.014479 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb492196-c5, col_values=(('external_ids', {'iface-id': 'fb492196-c5fa-4287-907a-95b1098b4126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:4a:0c', 'vm-uuid': '25e1371d-6866-4ebb-a546-610aadd4e70e'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:30.016144 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.017340 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:30.023096 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.030863 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.033074 np0000004562 nova-compute[99148]: INFO os_vif [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=fb492196-c5fa-4287-907a-95b1098b4126,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb492196-c5') Jul 05 03:32:30.057684 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.061824 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.120946 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:32:30.128904 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Found WWN 3300000003ab19181 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:32:30.128904 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:30.128904 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== connect_volume: return (2327ms) {'type': 'block', 'scsi_wwn': '3300000003ab19181', 'path': '/dev/dm-0', 'multipath_id': '3300000003ab19181'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:30.128904 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003ab19181', 'path': '/dev/dm-0', 'multipath_id': '3300000003ab19181'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:32:30.242834 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1497e563-55df-4c9e-967c-3cae65c52d32 req-4f5ec49b-eb60-4e10-92c4-7e65e73c29c6 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Received event network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:30.243308 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1497e563-55df-4c9e-967c-3cae65c52d32 req-4f5ec49b-eb60-4e10-92c4-7e65e73c29c6 service nova] Acquiring lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:30.243564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1497e563-55df-4c9e-967c-3cae65c52d32 req-4f5ec49b-eb60-4e10-92c4-7e65e73c29c6 service nova] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:30.243564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1497e563-55df-4c9e-967c-3cae65c52d32 req-4f5ec49b-eb60-4e10-92c4-7e65e73c29c6 service nova] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:30.245276 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1497e563-55df-4c9e-967c-3cae65c52d32 req-4f5ec49b-eb60-4e10-92c4-7e65e73c29c6 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Processing event network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:30.385767 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.389793 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.415140 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.485105 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:30.507036 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:30.636925 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-586913105',id=17,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:32:17Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-jb0b6koh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:17Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=37710fe2-332b-40f8-818f-777113757600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:58:5e:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:30.637185 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "vif_mac": "fa:16:3e:58:5e:2f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:30.637536 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:30.638076 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'pci_devices' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:30.679325 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:30.679737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:30.683070 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:32:30.683458 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Claim successful on node np0000004562 Jul 05 03:32:30.833017 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:30.968450 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:31.140202 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] End _get_guest_xml xml= Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: instance-00000011 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-server-586913105 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 2026-07-05 03:32:27 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: True Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: bare Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: ide Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: pc Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: tempest-ServerBootFromVolumeStableRescueTest-2049298576 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: 614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: Jul 05 03:32:31.141646 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:31.149742 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance destroyed successfully. Jul 05 03:32:31.384583 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:31.470404 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:31.550939 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:31.551050 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:31.551208 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No VIF found with MAC fa:16:3e:ce:4a:0c, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:31.551887 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Using config drive Jul 05 03:32:31.667167 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-vif-unplugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:31.667594 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:31.667788 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:31.667952 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:31.668517 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] No event matching network-vif-unplugged-8052749e-94cf-4dc9-adc7-2435fc10905e in dict_keys([('network-vif-plugged', '8052749e-94cf-4dc9-adc7-2435fc10905e')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:32:31.668517 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-30d62abb-393f-4e55-9680-4e9d8ba0a443 req-bfaa4ebf-8ae3-4210-9241-54741f3da7e3 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received unexpected event network-vif-unplugged-8052749e-94cf-4dc9-adc7-2435fc10905e for instance with vm_state building and task_state spawning. Jul 05 03:32:32.059203 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:32.174151 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:32.174305 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:32.247898 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Creating config drive at /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.config Jul 05 03:32:32.265524 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponaxtvgt {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:32.326766 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:32.327169 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:32.329988 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponaxtvgt" returned: 0 in 0.064s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:32.335188 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Received event network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:32.335188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] Acquiring lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:32.335188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:32.335188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:32.335627 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] No waiting events found dispatching network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:32.335627 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-059bd637-4596-4503-9fb4-715c594502be req-1d76e67b-d95b-4e9a-8ecd-729d00d69cf4 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Received unexpected event network-vif-plugged-fb492196-c5fa-4287-907a-95b1098b4126 for instance with vm_state building and task_state spawning. Jul 05 03:32:32.670702 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:32.671136 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:32.671136 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:32.671136 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] No VIF found with MAC fa:16:3e:58:5e:2f, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:32.671527 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Using config drive Jul 05 03:32:32.676178 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:32:32.788848 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:32.809304 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:32.832001 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:33.085411 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:33.091174 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:33.174461 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'ec2_ids' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:33.225952 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:33.341017 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.661s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:33.341847 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.116s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:33.342022 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:33.348040 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:32:33.348114 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Claim successful on node np0000004562 Jul 05 03:32:33.425070 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999567177000017 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:33.426536 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance destroyed successfully. Jul 05 03:32:33.426959 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:33.586639 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:33.587214 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:33.587363 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] VM Started (Lifecycle Event) Jul 05 03:32:33.592183 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:33.594474 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Instance spawned successfully. Jul 05 03:32:33.594966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:33.679074 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:33.679074 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'keypairs' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:33.752304 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:33.752785 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:33.753022 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:33.753179 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:33.753326 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Processing event network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:33.753568 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:33.753859 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:33.753962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:33.754422 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:33.754422 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:33.754487 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] No waiting events found dispatching network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:33.754622 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-fc5ea81f-e2a6-48eb-b414-e8066edad6a5 req-b8680d48-d2ac-4fbe-a3f4-779f7c3a8105 service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received unexpected event network-vif-plugged-8052749e-94cf-4dc9-adc7-2435fc10905e for instance with vm_state building and task_state spawning. Jul 05 03:32:33.758131 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:33.761221 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Instance spawned successfully. Jul 05 03:32:33.762288 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:33.852491 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:33.852491 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:33.852491 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:33.852491 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:33.922589 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7fe0b14458841e59bc204d2b3feefc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829f33118604409f91b100dc1a08110f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:33.931948 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attempting rescue Jul 05 03:32:33.932518 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:32:33.941593 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:32:33.941739 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Creating image(s) Jul 05 03:32:33.942422 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:33.942615 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:33.943147 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "/opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:33.943341 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:34.089541 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:34.091107 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:34.103151 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.103291 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.103597 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.103875 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.104093 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.104376 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.181359 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:34.184940 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:34.280547 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.280688 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.281021 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.281242 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.281475 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.281746 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:34.351371 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Creating config drive at /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config.rescue Jul 05 03:32:34.354497 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:34.366591 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0y4li3og {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:34.386600 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Successfully created port: 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:34.412569 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0y4li3og" returned: 0 in 0.046s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:34.448428 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:34.450123 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:34.455866 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:34.457588 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:34.458083 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:34.458516 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:34.461512 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:34.461910 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:34.563238 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.101s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:34.564459 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:34.597113 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:32:34.602015 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:34.602262 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] VM Paused (Lifecycle Event) Jul 05 03:32:34.611403 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Took 7.35 seconds to spawn the instance on the hypervisor. Jul 05 03:32:34.611403 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:34.631960 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.rescue" returned: 0 in 0.068s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:34.632792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.175s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:34.633327 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'migration_context' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:34.788762 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Took 13.53 seconds to spawn the instance on the hypervisor. Jul 05 03:32:34.789251 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:34.864373 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:34.905025 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:34.912736 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:35.015894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:35.105612 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Successfully updated port: 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:35.119290 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:35.125064 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:35.125064 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] VM Resumed (Lifecycle Event) Jul 05 03:32:35.139113 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:35.141356 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Took 13.07 seconds to build instance. Jul 05 03:32:35.142305 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:35.143165 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start _get_guest_xml network_info=[{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:73:41:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:35.143328 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:35.209523 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:35.209844 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:35.303154 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Took 19.23 seconds to build instance. Jul 05 03:32:35.611860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:35.611860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:35.611860 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:35.630555 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:35.634036 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:35.657737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "25e1371d-6866-4ebb-a546-610aadd4e70e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.593s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:35.661920 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:35.667008 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:35.685450 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-561721903', uuid='7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585'), owner=OwnerMeta(userid='76127ae0b2ae45ff8d4cd7430fc67ec7', username='tempest-ServerRescueNegativeTestJSON-447473610-project-member', projectid='e31f3215e6204f19859b8f62235b8cb7', projectname='tempest-ServerRescueNegativeTestJSON-447473610'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:73:41:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222355.6784706) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:35.689824 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:35.692392 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:35.698363 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:35.702273 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:35.703876 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:35.705885 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:35.706628 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:35.709662 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:35.710284 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:35.711281 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:35.713115 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:35.713115 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:35.713617 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:35.716414 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:35.716627 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:35.717260 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:35.718550 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:35.721616 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:35.811232 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-c35bb71d-3808-498d-a375-e3a528426aac tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:35.811630 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-657927d6-fe96-4389-8dcc-63c52901b183 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.753s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:35.834034 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:35.834034 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing instance network info cache due to event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:35.834034 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:35.882480 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:35.883822 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:35.884215 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Creating image(s) Jul 05 03:32:35.887853 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:35.887853 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:35.887853 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:35.887853 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:35.888997 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:35.893451 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:35.977953 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:35.978367 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:35.978843 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:35.980691 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:35.982244 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:35.982580 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:36.075343 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:36.075955 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:36.129005 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk 1073741824" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:36.129005 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.149s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:36.129005 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:36.153066 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:36.153066 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] VM Resumed (Lifecycle Event) Jul 05 03:32:36.224131 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:36.231426 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:32:36.231426 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:36.253351 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:36.258402 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.916s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:36.259164 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:36.276430 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:36.309104 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-561721903',display_name='tempest-ServerRescueNegativeTestJSON-server-561721903',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-561721903',id=14,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5C1PD7kMqh+7KVuuShtRFCyVUOnOd/2IlikAG4AzRLIo5GTkr7ifn9Wd/Ybwxq52FR0i5LiFl0RT1NSP3Zf/7oDmhZv5cJa8w5AI2yZF3+uyyVWgxfGq6Z+37o9w5PRQ==',key_name='tempest-keypair-651564886',keypairs=,launch_index=0,launched_at=2026-07-05T03:31:34Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-exzz2q3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:73:41:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:36.309321 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "vif_mac": "fa:16:3e:73:41:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:36.309993 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:36.310963 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:36.327577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:36.327910 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Cannot resize image /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:32:36.328219 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:36.328403 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:36.330819 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:36.330979 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:36.331135 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:36.387096 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:36.511428 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:36.662408 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:36.664252 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:36.666596 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:36.797786 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:36.798045 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:36.798618 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:36.798683 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:36.815656 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] End _get_guest_xml xml= Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: instance-0000000e Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-server-561721903 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 2026-07-05 03:32:35 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: True Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: bare Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: ide Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: pc Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610-project-member Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: tempest-ServerRescueNegativeTestJSON-447473610 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: Jul 05 03:32:36.816683 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:36.822872 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance destroyed successfully. Jul 05 03:32:36.913091 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f4cefd470164250ac4e73cf5aaf1449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57631378c6a40a2bdeba7820098a52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:37.147529 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Unrescuing Jul 05 03:32:37.147529 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:37.147742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquired lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:37.147742 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:37.154738 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Received event network-changed-fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:37.154738 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Refreshing instance network info cache due to event network-changed-fb492196-c5fa-4287-907a-95b1098b4126. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:37.154958 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] Acquiring lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:37.154958 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] Acquired lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:37.155119 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Refreshing network info cache for port fb492196-c5fa-4287-907a-95b1098b4126 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:37.166462 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:37.169147 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance network_info: |[{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:37.169720 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:37.169947 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:37.173886 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Start _get_guest_xml network_info=[{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:37.180782 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 37710fe2-332b-40f8-818f-777113757600 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:32:37.181589 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:37.181828 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Resumed (Lifecycle Event) Jul 05 03:32:37.185685 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:37.186876 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-992270391', uuid='4a23ad30-ca25-4cdd-bc41-596617129de7'), owner=OwnerMeta(userid='a7fe0b14458841e59bc204d2b3feefc5', username='tempest-ServerStableDeviceRescueTest-1168613683-project-member', projectid='829f33118604409f91b100dc1a08110f', projectname='tempest-ServerStableDeviceRescueTest-1168613683'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222357.1864862) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:37.189562 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:37.190089 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:37.194087 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:37.194369 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:37.195789 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:37.196234 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:37.197360 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:37.198352 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:37.198654 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:37.198892 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:37.199133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:37.199331 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:37.199475 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:37.199621 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:37.199788 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:37.199946 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:37.221269 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-992270391',display_name='tempest-ServerStableDeviceRescueTest-server-992270391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverstabledevicerescuetest-server-992270391',id=20,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3cgpE1/whp8iCib/po0WOIrscQYIZo+CDlMaxzb0kY30M22S/ySFaRtjU2WKp7g7gbtxDdY68zz6czGutiDzU/CxfQ6LPCstnmSm3DUE6ZHSqfVsF+jAKVmuKaK1r4Pg==',key_name='tempest-keypair-859204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='829f33118604409f91b100dc1a08110f',ramdisk_id='',reservation_id='r-yynt2vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1168613683',owner_user_name='tempest-ServerStableDeviceRescueTest-1168613683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7fe0b14458841e59bc204d2b3feefc5',uuid=4a23ad30-ca25-4cdd-bc41-596617129de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:37.221269 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converting VIF {"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:37.222213 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:52:56,bridge_name='br-int',has_traffic_filtering=True,id=710c3a58-0bbc-436c-aebe-a5694d9449fa,network=Network(e0a356c5-90fd-4802-a58d-99145217c69d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710c3a58-0b') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:37.222748 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:37.301867 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:37.652746 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:37.658084 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:37.678187 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:37.689524 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:37.691824 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] End _get_guest_xml xml= Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: instance-00000014 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-server-992270391 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 2026-07-05 03:32:37 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: True Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: bare Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-1168613683-project-member Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-1168613683 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Preparing to wait for external event network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-992270391',display_name='tempest-ServerStableDeviceRescueTest-server-992270391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverstabledevicerescuetest-server-992270391',id=20,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3cgpE1/whp8iCib/po0WOIrscQYIZo+CDlMaxzb0kY30M22S/ySFaRtjU2WKp7g7gbtxDdY68zz6czGutiDzU/CxfQ6LPCstnmSm3DUE6ZHSqfVsF+jAKVmuKaK1r4Pg==',key_name='tempest-keypair-859204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='829f33118604409f91b100dc1a08110f',ramdisk_id='',reservation_id='r-yynt2vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1168613683',owner_user_name='tempest-ServerStableDeviceRescueTest-1168613683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7fe0b14458841e59bc204d2b3feefc5',uuid=4a23ad30-ca25-4cdd-bc41-596617129de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converting VIF {"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:52:56,bridge_name='br-int',has_traffic_filtering=True,id=710c3a58-0bbc-436c-aebe-a5694d9449fa,network=Network(e0a356c5-90fd-4802-a58d-99145217c69d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710c3a58-0b') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:37.730813 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:52:56,bridge_name='br-int',has_traffic_filtering=True,id=710c3a58-0bbc-436c-aebe-a5694d9449fa,network=Network(e0a356c5-90fd-4802-a58d-99145217c69d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710c3a58-0b') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:37.736167 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.736167 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:37.736167 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:37.741252 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.741252 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f0caa57-db83-5e31-8ea1-ad6fdde1b5bc', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:37.744676 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.744676 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:37.744933 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.749366 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.749675 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap710c3a58-0b, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:37.750257 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap710c3a58-0b, col_values=(('qos', UUID('8900d854-9489-4601-9e48-3e7a9da62fcd')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:37.750526 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap710c3a58-0b, col_values=(('external_ids', {'iface-id': '710c3a58-0bbc-436c-aebe-a5694d9449fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:52:56', 'vm-uuid': '4a23ad30-ca25-4cdd-bc41-596617129de7'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:37.752016 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.754491 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:37.761709 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.771006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.781530 np0000004562 nova-compute[99148]: INFO os_vif [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:52:56,bridge_name='br-int',has_traffic_filtering=True,id=710c3a58-0bbc-436c-aebe-a5694d9449fa,network=Network(e0a356c5-90fd-4802-a58d-99145217c69d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710c3a58-0b') Jul 05 03:32:37.805734 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:37.812757 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.815607 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:37.930934 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Successfully created port: 4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:37.956200 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:37.959898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing instance network info cache due to event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:37.961471 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] Acquiring lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:37.962443 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] Acquired lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:37.962570 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing network info cache for port 8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:38.119175 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:38.119175 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:38.193408 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:38.196740 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:32:38.196740 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:38.201743 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:38.202511 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Started (Lifecycle Event) Jul 05 03:32:38.236736 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:38.236736 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:38.264856 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:38.280117 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:38.327461 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:38.357036 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:38.357246 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:38.357384 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:38.357506 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] No VIF found with MAC fa:16:3e:73:41:ed, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:38.358173 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Using config drive Jul 05 03:32:38.465443 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:38.522827 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Updated VIF entry in instance network info cache for port fb492196-c5fa-4287-907a-95b1098b4126. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:38.522827 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] [instance: 25e1371d-6866-4ebb-a546-610aadd4e70e] Updating instance_info_cache with network_info: [{"id": "fb492196-c5fa-4287-907a-95b1098b4126", "address": "fa:16:3e:ce:4a:0c", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb492196-c5", "ovs_interfaceid": "fb492196-c5fa-4287-907a-95b1098b4126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:38.601495 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating instance_info_cache with network_info: [{"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:38.621431 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:32:38.630265 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updated VIF entry in instance network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:38.630849 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:38.653189 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Successfully updated port: 4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:38.707373 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:38.711498 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:38.724214 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-changed-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:38.724214 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Refreshing instance network info cache due to event network-changed-4ebbdb84-c359-4f1e-b797-6feda8f0a94d. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:38.724214 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] Acquiring lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:38.727778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] Acquired lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:38.728042 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Refreshing network info cache for port 4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:38.832832 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:38.835614 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:38.835938 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Creating image(s) Jul 05 03:32:38.836516 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:38.836654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "/opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:38.837145 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "/opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:38.837583 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:38.844826 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:38.844826 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:38.867050 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:38.873625 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.013067603000081363 future=) was cancelled during its delay period, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:38.874276 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:38.874479 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.55007698999998 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:38.874799 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.549956054999939 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:38.929470 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:38.930012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:38.931076 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:38.931638 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:38.936410 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:38.937575 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:39.005213 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:39.028691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c9e8bd8d-a99d-4427-95c8-ef7c3da07470 req-3b9eaccb-ffbc-4f9e-92a9-64ac2e9c8a28 service nova] Releasing lock "refresh_cache-25e1371d-6866-4ebb-a546-610aadd4e70e" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:39.032736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:39.033453 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:39.086697 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk 1073741824" returned: 0 in 0.053s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:39.092031 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.092396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:39.114845 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Releasing lock "refresh_cache-37710fe2-332b-40f8-818f-777113757600" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:39.118734 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'flavor' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:39.157648 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:39.158290 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c76689d0-7a97-428b-9364-2b8f4bce6b64 req-e00fdf45-40bd-4f0d-8347-ba18eb50ebee service nova] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:39.203784 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.111s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:39.204155 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:32:39.204400 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:39.223303 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updated VIF entry in instance network info cache for port 8052749e-94cf-4dc9-adc7-2435fc10905e. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:39.224929 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updating instance_info_cache with network_info: [{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:39.227948 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:32:39.232887 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.233470 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.236605 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:39.243676 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:32:39.244241 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Claim successful on node np0000004562 Jul 05 03:32:39.261268 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-vif-unplugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:39.261500 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.261593 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.261725 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.261880 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] No event matching network-vif-unplugged-710c3a58-0bbc-436c-aebe-a5694d9449fa in dict_keys([('network-vif-plugged', '710c3a58-0bbc-436c-aebe-a5694d9449fa')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:32:39.265057 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received unexpected event network-vif-unplugged-710c3a58-0bbc-436c-aebe-a5694d9449fa for instance with vm_state building and task_state spawning. Jul 05 03:32:39.265177 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:39.265316 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.265436 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.265553 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.265952 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] No waiting events found dispatching network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:39.265952 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received unexpected event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d for instance with vm_state building and task_state spawning. Jul 05 03:32:39.266052 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:39.266105 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.267882 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.268020 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.268314 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Processing event network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:39.273300 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:39.273624 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.273624 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.273800 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.273896 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] No waiting events found dispatching network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:39.274043 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-1893fd49-2004-436c-ac10-fe5044ade429 req-f835301f-be70-4366-a35a-0a256486c10f service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received unexpected event network-vif-plugged-710c3a58-0bbc-436c-aebe-a5694d9449fa for instance with vm_state building and task_state spawning. Jul 05 03:32:39.291387 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:39.291837 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Cannot resize image /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:32:39.292105 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:39.292244 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Ensure instance console log exists: /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:39.292890 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:39.293076 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:39.293259 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:39.309371 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:39.309491 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:39.309646 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No VIF found with MAC fa:16:3e:b8:52:56, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:39.310222 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Using config drive Jul 05 03:32:39.317252 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:39.374500 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:39.374635 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'keypairs' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:39.485980 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:39.639501 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:39.651549 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:39.738359 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-64b79a0b-547d-4fb6-941c-449b6acb28b8 req-8df0855b-ca5c-44a0-8741-39efc4ba0e3d service nova] Releasing lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:39.815687 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:39.877061 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:39.880290 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:39.978097 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Creating config drive at /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config Jul 05 03:32:39.982582 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999705792999976 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:39.983864 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_e6z_qes {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:40.001783 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance destroyed successfully. Jul 05 03:32:40.005936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c3227c68-be17-477c-87e7-c758aaf51089 req-7068ad75-e484-4925-904c-1fb0737594bf service nova] Releasing lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:40.008139 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'numa_topology' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:40.013100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquired lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:40.014466 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:40.044482 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_e6z_qes" returned: 0 in 0.061s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:40.060463 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Creating config drive at /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config.rescue Jul 05 03:32:40.064826 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfihkka86 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:40.112069 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfihkka86" returned: 0 in 0.047s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:40.514564 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Object Instance<37710fe2-332b-40f8-818f-777113757600> lazy-loaded attributes: flavor,numa_topology {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:40.618416 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:40.863838 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:40.925218 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:40.927499 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.062617 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Updating instance_info_cache with network_info: [{"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:41.080549 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:41.080549 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:41.336856 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.347284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.388128 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.434916 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.443249 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:41.565238 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Releasing lock "refresh_cache-ef4ed455-c916-4565-9d4e-1b9fc9262b91" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:41.565617 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance network_info: |[{"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:41.567243 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Start _get_guest_xml network_info=[{"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:41.571373 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:41.572593 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-542663628', uuid='ef4ed455-c916-4565-9d4e-1b9fc9262b91'), owner=OwnerMeta(userid='0f4cefd470164250ac4e73cf5aaf1449', username='tempest-VolumesAdminNegativeTest-1345359791-project-member', projectid='d57631378c6a40a2bdeba7820098a52d', projectname='tempest-VolumesAdminNegativeTest-1345359791'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222361.5722437) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:41.573547 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:41.573877 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:41.574684 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:41.574867 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:41.575661 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:41.575975 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:41.576103 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:41.576203 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:41.576342 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:41.576418 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:41.576505 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:41.576673 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:41.576814 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:41.576918 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:41.577029 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:41.577144 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:41.584546 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:41.593920 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542663628',display_name='tempest-VolumesAdminNegativeTest-server-542663628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesadminnegativetest-server-542663628',id=21,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d57631378c6a40a2bdeba7820098a52d',ramdisk_id='',reservation_id='r-z5grppbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1345359791',owner_user_name='tempest-VolumesAdminNegativeTest-1345359791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:38Z,user_data=None,user_id='0f4cefd470164250ac4e73cf5aaf1449',uuid=ef4ed455-c916-4565-9d4e-1b9fc9262b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:41.594142 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converting VIF {"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:41.594679 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:41.595288 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lazy-loading 'pci_devices' on Instance uuid ef4ed455-c916-4565-9d4e-1b9fc9262b91 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:42.092863 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.859s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:42.093369 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] End _get_guest_xml xml= Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: ef4ed455-c916-4565-9d4e-1b9fc9262b91 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: instance-00000015 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: tempest-VolumesAdminNegativeTest-server-542663628 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 2026-07-05 03:32:41 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: True Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: bare Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: tempest-VolumesAdminNegativeTest-1345359791-project-member Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: tempest-VolumesAdminNegativeTest-1345359791 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: ef4ed455-c916-4565-9d4e-1b9fc9262b91 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: ef4ed455-c916-4565-9d4e-1b9fc9262b91 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: Jul 05 03:32:42.098493 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:42.101533 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Preparing to wait for external event network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:42.101533 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:42.101533 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:42.101533 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:42.101533 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542663628',display_name='tempest-VolumesAdminNegativeTest-server-542663628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesadminnegativetest-server-542663628',id=21,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d57631378c6a40a2bdeba7820098a52d',ramdisk_id='',reservation_id='r-z5grppbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1345359791',owner_user_name='tempest-VolumesAdminNegativeTest-1345359791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:38Z,user_data=None,user_id='0f4cefd470164250ac4e73cf5aaf1449',uuid=ef4ed455-c916-4565-9d4e-1b9fc9262b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:42.102035 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converting VIF {"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:42.102793 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:42.102793 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:42.103771 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.104353 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:42.107522 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:42.107522 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.107522 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7745784-9116-5d1c-bc28-861cbfc6b28f', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:42.108147 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.109034 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:42.111158 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.111430 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ebbdb84-c3, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:42.111846 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ebbdb84-c3, col_values=(('qos', UUID('df498732-bc23-4607-946a-d61bc1535145')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:42.114387 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ebbdb84-c3, col_values=(('external_ids', {'iface-id': '4ebbdb84-c359-4f1e-b797-6feda8f0a94d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:00:aa', 'vm-uuid': 'ef4ed455-c916-4565-9d4e-1b9fc9262b91'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:42.114387 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.116450 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:42.120457 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.131530 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.132491 np0000004562 nova-compute[99148]: INFO os_vif [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') Jul 05 03:32:42.162519 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.171986 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.319326 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:32:42.319487 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:42.322535 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Resumed (Lifecycle Event) Jul 05 03:32:42.330984 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-7525b3fd-4c83-4efc-a65c-1d6da0b06efd tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:42.394208 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e71e5e7d-19cc-422a-b90c-c8ffc4d7f8f9 req-6bbb8f17-1ea5-49bc-80c3-8596bb67c5e1 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:42.395707 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e71e5e7d-19cc-422a-b90c-c8ffc4d7f8f9 req-6bbb8f17-1ea5-49bc-80c3-8596bb67c5e1 service nova] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:42.396845 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e71e5e7d-19cc-422a-b90c-c8ffc4d7f8f9 req-6bbb8f17-1ea5-49bc-80c3-8596bb67c5e1 service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:42.396845 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e71e5e7d-19cc-422a-b90c-c8ffc4d7f8f9 req-6bbb8f17-1ea5-49bc-80c3-8596bb67c5e1 service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:42.396845 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e71e5e7d-19cc-422a-b90c-c8ffc4d7f8f9 req-6bbb8f17-1ea5-49bc-80c3-8596bb67c5e1 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Processing event network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:42.448181 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de45238f-01b7-4a10-926e-a57ffdbb5f82 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:42.517266 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:42.523430 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:42.525206 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance spawned successfully. Jul 05 03:32:42.525571 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:42.529518 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.533678 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.541997 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.568256 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.571956 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:42.609509 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:32:42.610164 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:32:42.610891 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:42.611205 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:42.699423 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13eaeef1f2334d698ac49202f06873c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef60743c71546fc87af8540e17c0506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:32:42.830591 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:42.836193 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:43.032724 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.032881 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.033737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.033737 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.034131 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.035415 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:43.111525 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:32:43.148920 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Successfully created port: f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:32:43.339350 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:43.340653 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Started (Lifecycle Event) Jul 05 03:32:43.547488 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Took 7.66 seconds to spawn the instance on the hypervisor. Jul 05 03:32:43.547488 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:43.617041 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:32:43.666323 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:43.666323 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:43.666323 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] No VIF found with MAC fa:16:3e:04:00:aa, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:43.666323 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Using config drive Jul 05 03:32:43.827724 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "37710fe2-332b-40f8-818f-777113757600" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:43.828022 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:43.828321 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:43.828435 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:43.828590 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:43.839959 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Terminating instance Jul 05 03:32:43.846100 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:43.850026 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:43.869362 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Successfully updated port: f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:32:43.950262 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:43.950308 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing instance network info cache due to event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:43.950555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] Acquiring lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:43.950555 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] Acquired lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:43.950940 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing network info cache for port f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:44.060915 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Took 13.43 seconds to build instance. Jul 05 03:32:44.173539 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:44.335683 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Creating config drive at /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.config Jul 05 03:32:44.339559 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76772ig8 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:44.352857 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:32:44.355103 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 37710fe2-332b-40f8-818f-777113757600 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:32:44.355596 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:44.355954 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Resumed (Lifecycle Event) Jul 05 03:32:44.368901 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:44.373418 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:44.382221 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:44.391019 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76772ig8" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:44.456056 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:44.467975 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:44.468198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:44.468445 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:44.471620 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:44.472063 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] No waiting events found dispatching network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:44.474933 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-bad2f8e4-79eb-4264-b868-0ccfb93a6116 req-9ba5e9d2-5b05-4b23-b73d-cf07531a54db service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received unexpected event network-vif-plugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d for instance with vm_state building and task_state spawning. Jul 05 03:32:44.476040 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Unrescuing Jul 05 03:32:44.476339 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:44.476339 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:44.476624 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:44.564319 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.945s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:44.567325 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:44.628313 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:32:44.629501 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:32:44.632889 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Creating image(s) Jul 05 03:32:44.633835 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:44.633945 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:44.634434 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:44.635051 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:44.644439 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:44.645925 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:44.759201 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.113s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:44.759621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:44.760168 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:44.760630 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:44.764117 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:32:44.764588 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:44.783649 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:44.861326 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:44.887163 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.122s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:44.888448 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:44.911642 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:44.911923 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Started (Lifecycle Event) Jul 05 03:32:44.918326 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Instance destroyed successfully. Jul 05 03:32:44.918988 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid 37710fe2-332b-40f8-818f-777113757600 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:44.940321 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk 1073741824" returned: 0 in 0.052s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:44.940804 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.181s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:44.942297 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:44.987884 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:45.034706 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.047238 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.051417 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.110s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:45.052078 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:32:45.052387 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:45.127625 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:45.128087 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Cannot resize image /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:32:45.128584 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:32:45.128925 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Ensure instance console log exists: /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:32:45.129282 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:45.129541 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:45.129773 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:45.288953 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b9f2b4e-0eea-41af-9ae8-ad04fad67a2d req-3dff7dd4-13b7-405a-8d37-d0acbdbf1eb4 service nova] Releasing lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:45.292317 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:45.292317 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:32:45.383085 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:45.421554 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:45.425572 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-586913105',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-586913105',id=17,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:32:35Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-jb0b6koh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:32:42Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=37710fe2-332b-40f8-818f-777113757600,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:32:45.425572 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "address": "fa:16:3e:58:5e:2f", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cc4cdb-f6", "ovs_interfaceid": "77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:45.425572 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:45.425572 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:32:45.429308 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:45.429469 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Started (Lifecycle Event) Jul 05 03:32:45.455086 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.465922 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.466361 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77cc4cdb-f6, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:45.468291 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.469559 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:45.484204 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.487176 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.487449 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcb94993-60a6-4867-9570-d0a5de39b77a) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:45.490002 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.491248 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:45.496865 np0000004562 nova-compute[99148]: INFO os_vif [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cc4cdb-f6') Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '614876c0-4fe6-4f48-9a0c-c593830cf43b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:32:45.499462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '27')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '28')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:45.538508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Resulting device map defaultdict(. at 0x7249ac67e200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:32:45.540402 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:32:45.540402 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flush multipath device 3300000003ab19181 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:32:45.551356 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:45.600874 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:45.643835 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:45.662868 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.664154 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:45.671491 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:45.671763 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Cleaning up deleted instances {{(pid=99148) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12095}} Jul 05 03:32:45.706216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:32:45.706216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:32:45.706216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:32:45.721097 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:32:45.721097 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:32:45.734428 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:45.735836 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:45.736056 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:45.736248 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:45.736418 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] No waiting events found dispatching network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:45.736571 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-fea37ba2-375a-44fc-8d86-3183820a2565 req-ed090fe1-b316-4dfe-af35-ea7c9e350e8d service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:32:45.739399 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.779814 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.40.100,3260] Jul 05 03:32:45.779814 np0000004562 nova-compute[99148]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.40.100,3260] successful. Jul 05 03:32:45.779814 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.808907 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.821618 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.861173 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.50.100,3260] Jul 05 03:32:45.861173 np0000004562 nova-compute[99148]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b, portal: 192.168.50.100,3260] successful. Jul 05 03:32:45.861173 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.875293 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:32:45.882149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:45.882149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:45.882149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== disconnect_volume: return (382ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:45.882149 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:32:45.882149 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Deleting instance files /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600_del Jul 05 03:32:45.887250 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Deletion of /opt/stack/data/nova/instances/37710fe2-332b-40f8-818f-777113757600_del complete Jul 05 03:32:45.936269 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:45.940279 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:46.054621 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:46.057211 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'flavor' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:46.072397 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:46.072535 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing instance network info cache due to event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:46.072746 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:46.072846 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:46.072962 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:46.082132 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:46.086653 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:46.092028 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance spawned successfully. Jul 05 03:32:46.092028 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:46.116987 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:46.181223 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] There are 0 instances to clean {{(pid=99148) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12104}} Jul 05 03:32:46.182247 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:46.182387 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Cleaning up deleted instances with incomplete migration {{(pid=99148) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12133}} Jul 05 03:32:46.317653 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updating instance_info_cache with network_info: [{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:46.391322 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:46.397466 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Took 2.04 seconds to destroy the instance on the hypervisor. Jul 05 03:32:46.398543 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:32:46.398812 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:32:46.398982 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 37710fe2-332b-40f8-818f-777113757600] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:32:46.399245 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:46.442937 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:46.443247 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Paused (Lifecycle Event) Jul 05 03:32:46.473025 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:46.568376 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:46.578465 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:46.580193 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:46.601113 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.601252 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.601589 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.601868 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.602115 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.602349 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:46.684638 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:46.803809 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a9b09ae8-b248-46d2-91c1-f1b1c7496d59 req-7b993ef6-1b62-43d5-8a6e-a9fef1df6c2b service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-deleted-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:46.804480 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-a9b09ae8-b248-46d2-91c1-f1b1c7496d59 req-7b993ef6-1b62-43d5-8a6e-a9fef1df6c2b service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Neutron deleted interface 77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df; detaching it from the instance and deleting it from the info cache Jul 05 03:32:46.805987 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a9b09ae8-b248-46d2-91c1-f1b1c7496d59 req-7b993ef6-1b62-43d5-8a6e-a9fef1df6c2b service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Detach interface failed, port_id=77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df, reason: Instance 37710fe2-332b-40f8-818f-777113757600 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:32:46.820401 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:46.820688 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Instance network_info: |[{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:32:46.825903 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Start _get_guest_xml network_info=[{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:32:46.830991 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:46.832203 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='cc621bcb-52cf-4d0c-9df2-36b453b50c50'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222366.8318973) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:32:46.833597 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:32:46.833956 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:32:46.834668 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:32:46.835606 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:32:46.837077 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:32:46.837421 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:32:46.837576 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:32:46.837672 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:32:46.837893 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:32:46.838075 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:32:46.838075 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:32:46.838328 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:32:46.838422 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:32:46.838571 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:32:46.838702 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:32:46.838860 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:32:46.850390 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-1',id=22,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-0k2d4307',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=cc621bcb-52cf-4d0c-9df2-36b453b50c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:32:46.850583 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:46.851099 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:94,bridge_name='br-int',has_traffic_filtering=True,id=f2e20c4f-b8a4-42a7-aca4-1495201a8879,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e20c4f-b8') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:46.851842 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'pci_devices' on Instance uuid cc621bcb-52cf-4d0c-9df2-36b453b50c50 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:46.896433 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance destroyed successfully. Jul 05 03:32:46.896548 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:46.926556 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:46.945676 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:46.947286 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:46.947412 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Resumed (Lifecycle Event) Jul 05 03:32:47.061478 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updated VIF entry in instance network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:47.061751 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:47.106897 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Took 8.27 seconds to spawn the instance on the hypervisor. Jul 05 03:32:47.107006 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:47.188171 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:47.232635 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] End _get_guest_xml xml= Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: cc621bcb-52cf-4d0c-9df2-36b453b50c50 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: instance-00000016 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 196608 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: multiattach-server-1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 2026-07-05 03:32:46 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 192 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: True Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: bare Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 0 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: virtio Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: cc621bcb-52cf-4d0c-9df2-36b453b50c50 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: cc621bcb-52cf-4d0c-9df2-36b453b50c50 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: hvm Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 128 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: 1 Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: Jul 05 03:32:47.354781 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Preparing to wait for external event network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-1',id=22,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-0k2d4307',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=cc621bcb-52cf-4d0c-9df2-36b453b50c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:47.357030 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:94,bridge_name='br-int',has_traffic_filtering=True,id=f2e20c4f-b8a4-42a7-aca4-1495201a8879,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e20c4f-b8') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:47.357302 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:94,bridge_name='br-int',has_traffic_filtering=True,id=f2e20c4f-b8a4-42a7-aca4-1495201a8879,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e20c4f-b8') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:32:47.357471 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.357651 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:47.358141 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:32:47.359049 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.359203 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61c47f6f-4a98-5acc-8ef7-27477fb77990', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:47.359992 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.360783 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:47.363188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.365345 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.365504 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e20c4f-b8, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:47.365864 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e20c4f-b8, col_values=(('qos', UUID('6bde86bb-3637-4d0f-84b8-6501a941d05d')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:47.366029 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e20c4f-b8, col_values=(('external_ids', {'iface-id': 'f2e20c4f-b8a4-42a7-aca4-1495201a8879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:5c:94', 'vm-uuid': 'cc621bcb-52cf-4d0c-9df2-36b453b50c50'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:47.366913 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.368119 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:47.373675 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.380558 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.385837 np0000004562 nova-compute[99148]: INFO os_vif [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:94,bridge_name='br-int',has_traffic_filtering=True,id=f2e20c4f-b8a4-42a7-aca4-1495201a8879,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e20c4f-b8') Jul 05 03:32:47.398252 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Object Instance<7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585> lazy-loaded attributes: flavor,numa_topology {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:32:47.421165 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.422906 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.453305 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:47.459809 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:47.563788 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e6d0e333-b4e4-483f-a3bb-36cd7288897e req-37d5a3ec-0e66-4953-9ed8-9e64cf3e8a71 service nova] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:47.565829 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.568086 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.615579 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Took 14.43 seconds to build instance. Jul 05 03:32:47.737232 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 37710fe2-332b-40f8-818f-777113757600] Took 1.34 seconds to deallocate network for instance. Jul 05 03:32:47.829127 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:47.829370 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] Acquiring lock "37710fe2-332b-40f8-818f-777113757600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:47.829564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:47.829765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] Lock "37710fe2-332b-40f8-818f-777113757600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:47.829945 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] No waiting events found dispatching network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:47.830097 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4433c2b0-09e6-496d-b5e5-402d2a201d80 req-4644fc73-55c3-4478-9cdf-9ec0f1effdde service nova] [instance: 37710fe2-332b-40f8-818f-777113757600] Received event network-vif-unplugged-77cc4cdb-f6aa-43b6-8bc5-aae4974ef6df for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:32:47.908274 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.917793 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:47.962558 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999740749000011 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:47.962793 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:47.962936 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] VM Started (Lifecycle Event) Jul 05 03:32:48.117215 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-2e98e0a4-a3a9-42dc-abbb-876887b95f61 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.943s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:48.135318 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received event network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:48.135452 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:48.135593 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:48.135922 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:48.136028 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Processing event network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:32:48.136143 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received event network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:48.136261 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:48.136389 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:48.136510 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:48.136603 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] No waiting events found dispatching network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:48.136781 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-b962e800-6679-48ab-b224-52949a72c650 req-5b8a8d13-b739-4f59-b16f-2db1cc09a179 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received unexpected event network-vif-plugged-f2e20c4f-b8a4-42a7-aca4-1495201a8879 for instance with vm_state building and task_state spawning. Jul 05 03:32:48.181890 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:48.182372 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:48.298009 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Took 0.56 seconds to detach 1 volumes for instance. Jul 05 03:32:48.300213 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Deleting volume: 614876c0-4fe6-4f48-9a0c-c593830cf43b {{(pid=99148) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3457}} Jul 05 03:32:48.424969 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003916789999038883 future=) was cancelled during its delay period, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.5570837570001 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=6.557008997999901 future=) was cancelled while queued, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.536888083000122 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.425507 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.536782988000141 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:48.467620 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:48.467876 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:48.670229 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:48.670229 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:48.714791 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-c3d5b9ac-4754-4aea-a7ff-19967b54481e tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:48.866737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:48.867493 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:48.913775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:48.913775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:32:48.913775 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:a0:5c:94, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:32:48.913775 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Using config drive Jul 05 03:32:48.970106 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:48.971514 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] VM Paused (Lifecycle Event) Jul 05 03:32:49.420746 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:49.473686 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:49.476385 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:49.476576 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] VM Resumed (Lifecycle Event) Jul 05 03:32:49.591747 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Creating config drive at /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.config Jul 05 03:32:49.599071 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjbvb7327 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:49.657612 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjbvb7327" returned: 0 in 0.059s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:49.669900 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:49.670198 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:49.693812 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:49.693812 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:49.981409 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:49.989370 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:50.155759 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:50.160443 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:50.178914 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:50.196253 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:50.206136 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:50.206493 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing instance network info cache due to event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:50.206741 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:50.206892 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:50.207063 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:50.492513 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999664818000156 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:50.492966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:32:50.493971 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:50.493971 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Resumed (Lifecycle Event) Jul 05 03:32:50.707415 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.841s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:50.708593 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.530s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:50.708819 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:50.709028 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:32:50.709471 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:50.787430 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Deleted allocations for instance 37710fe2-332b-40f8-818f-777113757600 Jul 05 03:32:50.815751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:50.815751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:50.815751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:50.815751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:50.815751 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:50.819190 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Terminating instance Jul 05 03:32:50.995998 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:50.998222 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:51.079483 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:32:51.084301 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:32:51.091990 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Instance spawned successfully. Jul 05 03:32:51.092487 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:32:51.109672 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:51.325653 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:32:51.331499 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updated VIF entry in instance network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:51.332771 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:51.336798 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:51.349123 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:51.393297 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:51.501164 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:51.501648 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Started (Lifecycle Event) Jul 05 03:32:51.602015 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.602186 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.602353 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.602550 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.602811 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.603047 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:32:51.635197 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Instance destroyed successfully. Jul 05 03:32:51.635607 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lazy-loading 'resources' on Instance uuid ef4ed455-c916-4565-9d4e-1b9fc9262b91 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:51.792266 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:51.811782 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c9e838f1-33c5-4f4d-9d2a-df65d47252ed tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "37710fe2-332b-40f8-818f-777113757600" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.983s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:51.836527 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:51.836799 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:51.836944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing instance network info cache due to event network-changed-ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:51.837184 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Acquiring lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:51.837275 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Acquired lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:51.837413 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Refreshing network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:51.877336 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:51.877857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:51.957693 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:51.961504 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.004776 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:52.007124 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:52.060832 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.061227 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.108896 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Took 7.48 seconds to spawn the instance on the hypervisor. Jul 05 03:32:52.109121 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:52.141207 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542663628',display_name='tempest-VolumesAdminNegativeTest-server-542663628',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumesadminnegativetest-server-542663628',id=21,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:32:47Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d57631378c6a40a2bdeba7820098a52d',ramdisk_id='',reservation_id='r-z5grppbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1345359791',owner_user_name='tempest-VolumesAdminNegativeTest-1345359791-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:32:47Z,user_data=None,user_id='0f4cefd470164250ac4e73cf5aaf1449',uuid=ef4ed455-c916-4565-9d4e-1b9fc9262b91,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:32:52.141207 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converting VIF {"id": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "address": "fa:16:3e:04:00:aa", "network": {"id": "57b2e99b-0e1f-4352-8fc7-4ee7944e5d88", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-188692022-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d57631378c6a40a2bdeba7820098a52d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebbdb84-c3", "ovs_interfaceid": "4ebbdb84-c359-4f1e-b797-6feda8f0a94d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:52.142209 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:52.142209 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:32:52.170377 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.176617 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.176617 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:32:52.176997 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.198745 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.198745 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ebbdb84-c3, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:52.202343 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.204334 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:52.225950 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.227916 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.228284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df498732-bc23-4607-946a-d61bc1535145) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:52.230471 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:52.235090 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:52.242961 np0000004562 nova-compute[99148]: INFO os_vif [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:aa,bridge_name='br-int',has_traffic_filtering=True,id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d,network=Network(57b2e99b-0e1f-4352-8fc7-4ee7944e5d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebbdb84-c3') Jul 05 03:32:52.244942 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Deleting instance files /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91_del Jul 05 03:32:52.246188 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Deletion of /opt/stack/data/nova/instances/ef4ed455-c916-4565-9d4e-1b9fc9262b91_del complete Jul 05 03:32:52.263264 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.264799 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.340538 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:52.361771 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.365691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.391502 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:52.393110 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:52.395967 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:52.395967 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:52.395967 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] No waiting events found dispatching network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:52.395967 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b189c58f-834a-4b41-9271-70c91d59e465 req-99dc1fa9-ef81-4864-9a70-1dc0554d21b4 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:32:52.474546 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.475277 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.511885 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:52.511885 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] VM Started (Lifecycle Event) Jul 05 03:32:52.564481 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.576829 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:32:52.578423 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.627793 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Took 13.48 seconds to build instance. Jul 05 03:32:52.670654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.671186 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.761006 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.762730 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Took 1.44 seconds to destroy the instance on the hypervisor. Jul 05 03:32:52.764284 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:32:52.766766 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:32:52.766766 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:32:52.766766 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:52.770512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.866333 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:52.887117 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.119s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.887563 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:52.925361 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:52.950900 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:52.951281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:52.951564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:52.951839 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:52.952005 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:52.957045 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Terminating instance Jul 05 03:32:52.979792 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk.rescue --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:52.980310 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.017624 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:53.027494 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:53.092753 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updated VIF entry in instance network info cache for port ae99d539-260e-4455-b60f-28b27e1002a8. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:53.093300 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [{"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:53.095494 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.097253 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.131508 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a73b9466-3f39-4905-ac8f-c990bb1f4c33 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.012s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:53.200294 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.203237 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.228167 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-50beb2fa-7caf-4d8e-9f86-7aa6ac812aec req-5aee1172-82cf-4fc1-883c-8781d66997f9 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-deleted-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:53.228818 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-50beb2fa-7caf-4d8e-9f86-7aa6ac812aec req-5aee1172-82cf-4fc1-883c-8781d66997f9 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Neutron deleted interface 4ebbdb84-c359-4f1e-b797-6feda8f0a94d; detaching it from the instance and deleting it from the info cache Jul 05 03:32:53.231428 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-50beb2fa-7caf-4d8e-9f86-7aa6ac812aec req-5aee1172-82cf-4fc1-883c-8781d66997f9 service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Detach interface failed, port_id=4ebbdb84-c359-4f1e-b797-6feda8f0a94d, reason: Instance ef4ed455-c916-4565-9d4e-1b9fc9262b91 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:32:53.307388 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.308096 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.418066 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.421181 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:32:53.422451 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.461511 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:32:53.467088 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:53.479529 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:53.503100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.503549 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.531896 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:53.532275 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] VM Paused (Lifecycle Event) Jul 05 03:32:53.584618 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.588252 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.601644 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-cb7f9b61-3497-4da7-8e26-e111ff1f5845 req-62473a76-3bc2-462d-a19e-86720f5ff971 service nova] Releasing lock "refresh_cache-7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:53.667638 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.668084 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.683080 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:53.768131 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.772098 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'ef4ed455-c916-4565-9d4e-1b9fc9262b91' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ef4ed455-c916-4565-9d4e-1b9fc9262b91' (instance-00000015) Jul 05 03:32:53.772671 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:32:53.776865 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:53.804924 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Instance destroyed successfully. Jul 05 03:32:53.805339 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid 28b3c393-2575-4bb8-af24-988f514af885 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:53.817358 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:53.819446 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=49509MB free_disk=74.17707443237305GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:32:53.819446 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:53.819446 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:54.036085 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:54.038140 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:32:54.038140 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] VM Resumed (Lifecycle Event) Jul 05 03:32:54.192322 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Took 1.43 seconds to deallocate network for instance. Jul 05 03:32:54.311286 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-899021781',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-899021781',id=15,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:43Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-08446pw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:53Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=28b3c393-2575-4bb8-af24-988f514af885,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:32:54.311543 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "efa430bb-f196-4ebf-96da-ef606d52fe85", "address": "fa:16:3e:47:9a:d0", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa430bb-f1", "ovs_interfaceid": "efa430bb-f196-4ebf-96da-ef606d52fe85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:32:54.312148 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:32:54.312384 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:32:54.338571 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.341360 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.352909 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.356648 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefa430bb-f1, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:54.367290 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.369417 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:54.370619 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.370894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2bed7f9-9653-4a39-9320-3250d0c371b3) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:32:54.371553 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.374241 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:32:54.376576 np0000004562 nova-compute[99148]: INFO os_vif [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9a:d0,bridge_name='br-int',has_traffic_filtering=True,id=efa430bb-f196-4ebf-96da-ef606d52fe85,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa430bb-f1') Jul 05 03:32:54.377137 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Deleting instance files /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885_del Jul 05 03:32:54.378565 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Deletion of /opt/stack/data/nova/instances/28b3c393-2575-4bb8-af24-988f514af885_del complete Jul 05 03:32:54.445818 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:54.446021 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] Acquiring lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:54.446251 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:54.446381 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:54.446508 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] No waiting events found dispatching network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:54.446642 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-760cec31-42e7-451d-9b8f-9f839448b055 req-6336d438-5e06-4ee1-b212-81425226aa4d service nova] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Received unexpected event network-vif-unplugged-4ebbdb84-c359-4f1e-b797-6feda8f0a94d for instance with vm_state deleted and task_state None. Jul 05 03:32:54.506978 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.509509 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:54.542089 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:32:54.545352 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:32:54.701081 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:54.885187 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Took 1.42 seconds to destroy the instance on the hypervisor. Jul 05 03:32:54.885642 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:32:54.885824 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:32:54.885932 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:32:54.886178 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:54.939692 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance d22f1b3c-5d43-486e-a417-325d749fca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.939847 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 79dcf4df-1d4d-462e-9b02-4bf431533787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.939970 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 4d856996-148c-4732-9428-4f5611315969 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.940085 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance a123d3ff-9f01-46b6-838c-11bc579124ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 28b3c393-2575-4bb8-af24-988f514af885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 5e2ef932-ebb3-4532-aa04-0c0a7602812a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 134dd22e-099b-4049-b8c3-8bbd75028bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 25e1371d-6866-4ebb-a546-610aadd4e70e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 4a23ad30-ca25-4cdd-bc41-596617129de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance ef4ed455-c916-4565-9d4e-1b9fc9262b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941315 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:32:54.941530 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:32:54.941530 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:32:53 up 29 min, 2 users, load average: 9.49, 5.46, 2.58\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '10', 'num_os_type_None': '12', 'num_proj_c3465ef2c67b48a5a9eeb4bea4ff9fff': '3', 'io_workload': '0', 'num_proj_e31f3215e6204f19859b8f62235b8cb7': '3', 'num_vm_rescued': '1', 'num_task_deleting': '2', 'num_proj_4ef60743c71546fc87af8540e17c0506': '3', 'num_proj_fe307c595da542e184ffe93fcfd11d4c': '1', 'num_proj_829f33118604409f91b100dc1a08110f': '1', 'num_proj_d57631378c6a40a2bdeba7820098a52d': '1'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:32:54.967154 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:55.046560 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999750677000065 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:55.046832 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999832660000038 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:32:55.302651 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Received event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:55.306011 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing instance network info cache due to event network-changed-8052749e-94cf-4dc9-adc7-2435fc10905e. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:55.306223 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Acquiring lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:55.306318 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Acquired lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:55.306428 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Refreshing network info cache for port 8052749e-94cf-4dc9-adc7-2435fc10905e {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:55.327379 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8ff5c133-2d3b-4498-88e5-2279d7963c93 req-82f88997-766c-467d-b2bd-b671f616bd11 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-vif-deleted-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:55.327529 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-8ff5c133-2d3b-4498-88e5-2279d7963c93 req-82f88997-766c-467d-b2bd-b671f616bd11 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Neutron deleted interface efa430bb-f196-4ebf-96da-ef606d52fe85; detaching it from the instance and deleting it from the info cache Jul 05 03:32:55.333664 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8ff5c133-2d3b-4498-88e5-2279d7963c93 req-82f88997-766c-467d-b2bd-b671f616bd11 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Detach interface failed, port_id=efa430bb-f196-4ebf-96da-ef606d52fe85, reason: Instance 28b3c393-2575-4bb8-af24-988f514af885 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:32:55.554344 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:55.554857 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:55.771274 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:55.808235 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:56.057337 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:56.082289 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:56.208068 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:56.208695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:56.233310 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updated VIF entry in instance network info cache for port 8052749e-94cf-4dc9-adc7-2435fc10905e. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:56.233539 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updating instance_info_cache with network_info: [{"id": "8052749e-94cf-4dc9-adc7-2435fc10905e", "address": "fa:16:3e:19:0b:53", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8052749e-94", "ovs_interfaceid": "8052749e-94cf-4dc9-adc7-2435fc10905e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:56.273441 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Took 1.39 seconds to deallocate network for instance. Jul 05 03:32:56.404476 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:56.499896 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:56.500463 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:56.500649 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:56.500821 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:56.500922 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] No waiting events found dispatching network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:56.501031 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received unexpected event network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 for instance with vm_state deleted and task_state None. Jul 05 03:32:56.501119 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received event network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:56.501255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Acquiring lock "28b3c393-2575-4bb8-af24-988f514af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:56.501367 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:56.501470 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] Lock "28b3c393-2575-4bb8-af24-988f514af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:56.501563 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] No waiting events found dispatching network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:32:56.501679 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-11e193e5-10db-4e91-80d6-74a208a64ec7 req-db176780-8309-4eb0-a234-2b8385950fd6 service nova] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Received unexpected event network-vif-unplugged-efa430bb-f196-4ebf-96da-ef606d52fe85 for instance with vm_state deleted and task_state None. Jul 05 03:32:56.565400 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:32:56.565847 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.747s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:56.565878 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.865s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:56.566159 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:56.712890 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 134dd22e-099b-4049-b8c3-8bbd75028bdf {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:32:56.736166 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Releasing lock "refresh_cache-134dd22e-099b-4049-b8c3-8bbd75028bdf" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:56.736357 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:32:56.736490 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing instance network info cache due to event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:32:56.736660 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Acquiring lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:32:56.736824 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Acquired lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:32:56.736934 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing network info cache for port f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:32:56.778989 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:57.091293 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:57.091539 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:57.238750 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:57.566596 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:32:57.568465 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:57.569656 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:57.569912 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:57.570088 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:57.570215 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:32:57.570426 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.10 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:32:57.594265 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:57.720334 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:57.724817 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updated VIF entry in instance network info cache for port f2e20c4f-b8a4-42a7-aca4-1495201a8879. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:32:57.725204 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updating instance_info_cache with network_info: [{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:32:58.101557 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.536s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:58.103431 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.324s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:58.172756 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Deleted allocations for instance ef4ed455-c916-4565-9d4e-1b9fc9262b91 Jul 05 03:32:58.228061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-43efa5be-ed42-469d-8bed-611fb5a6ed00 req-b79fd107-3083-4ba4-986f-f271c6302d4e service nova] Releasing lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:32:58.768098 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:32:58.768565 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:32:58.813245 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:32:58.813245 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:32:58.813245 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Attaching volume 4c04faaf-51aa-4375-9185-8fe3984e7671 to /dev/vdb Jul 05 03:32:58.881333 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:58.902861 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:32:58.927066 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:58.963851 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:32:58.964272 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:32:58.976632 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:32:58.979623 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94'] Jul 05 03:32:58.983891 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:32:58.984109 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:32:58.984467 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:58.984842 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Updating existing volume attachment record: 5a3abdee-506b-410a-bd8d-6f5ebef91d57 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:32:59.186783 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ee312e7a-faba-4774-b270-1f853fc50122 tempest-VolumesAdminNegativeTest-1345359791 tempest-VolumesAdminNegativeTest-1345359791-project-member] Lock "ef4ed455-c916-4565-9d4e-1b9fc9262b91" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.373s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:59.271177 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:32:59.372284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:32:59.541860 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:32:59.542206 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:59.542443 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:59.542701 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:59.542917 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:59.555894 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:59.556463 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:59.556955 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:59.557349 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:59.557581 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:59.558090 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:32:59.570925 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:59.570925 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.576484 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:59.576484 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671] added Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:59.584123 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.584459 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:59.584767 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:59.584956 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671] added Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:59.588610 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.588856 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:59.589117 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:59.589296 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:59.778018 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.675s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:32:59.855276 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Deleted allocations for instance 28b3c393-2575-4bb8-af24-988f514af885 Jul 05 03:33:00.585989 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:00.589775 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:00.604582 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:00.617066 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.620241 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.631459 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.639786 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.640041 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.645902 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.646124 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:00.684233 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.40.100,3260] Jul 05 03:33:00.684233 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.40.100,3260] successful. Jul 05 03:33:00.684233 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.692360 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.50.100,3260] Jul 05 03:33:00.692360 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.50.100,3260] successful. Jul 05 03:33:00.692360 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.697069 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.705199 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.715390 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.715649 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:00.716068 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:00.716216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:00.717540 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:00.717680 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.723011 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:00.723326 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:00.723534 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:00.723736 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:00.724769 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:00.724853 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:00.733308 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:00.733883 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:00.745792 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:00.745792 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:00.866220 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b6e62449-4854-4aab-aa98-5585ede93de9 tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "28b3c393-2575-4bb8-af24-988f514af885" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.915s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:01.234401 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:01.407251 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:01.459404 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:01.459622 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:01.459904 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:01.460061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:01.460297 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:01.465241 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Terminating instance Jul 05 03:33:01.514335 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:01.557800 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:33:01.971368 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:33:01.977431 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:01.989331 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.287365 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999519727999996 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.290881 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Instance destroyed successfully. Jul 05 03:33:02.291968 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid a123d3ff-9f01-46b6-838c-11bc579124ec {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:02.572910 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 3300000002cadf234 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:33:02.573159 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:02.573311 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000002cadf234', 'path': '/dev/dm-0', 'multipath_id': '3300000002cadf234'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:02.573424 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cadf234', 'path': '/dev/dm-0', 'multipath_id': '3300000002cadf234'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:33:02.576094 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 134dd22e-099b-4049-b8c3-8bbd75028bdf {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:02.794822 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-709522095',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-709522095',id=11,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:22Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-5s8ksnqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:28Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=a123d3ff-9f01-46b6-838c-11bc579124ec,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:33:02.795090 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "address": "fa:16:3e:fe:62:be", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40e5ce9-25", "ovs_interfaceid": "e40e5ce9-251f-4286-a5e0-a38e2c1a8c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:02.796064 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:02.796427 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:33:02.822648 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.826522 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.840310 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.840826 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape40e5ce9-25, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:02.841990 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.842838 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:02.853610 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.855619 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.855935 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=002ce0d1-2c5f-424f-b703-630c53fbaa94) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:02.859059 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:02.860149 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:02.861833 np0000004562 nova-compute[99148]: INFO os_vif [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:be,bridge_name='br-int',has_traffic_filtering=True,id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40e5ce9-25') Jul 05 03:33:02.863134 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:33:02.863386 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:02.863496 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:02.863825 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:02.864114 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:33:02.864238 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:02.897802 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:02.898097 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:02.898391 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '34')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:33:02.898391 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:02.901552 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:02.902780 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Resulting device map defaultdict(. at 0x72498c5e74c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'): ({'sdi'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:33:02.903076 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Removing multipathed devices sdh, sdi {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:33:02.903350 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Flush multipath device 330000000e226bb4b {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:33:02.939662 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:02.962843 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005351840000002994 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.962991 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.963495 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.5289443080000638 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.965050 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:02.965050 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.5276199790000646 future=) was cancelled while queued, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.965050 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] VM Stopped (Lifecycle Event) Jul 05 03:33:02.966247 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.966677 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.079659586000162 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.967103 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.079299356000092 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:02.999806 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:03.017637 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:03.018997 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:03.054523 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:33:03.054854 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:33:03.055796 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:33:03.067920 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:33:03.068110 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:33:03.079134 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Attempting to attach volume 4c04faaf-51aa-4375-9185-8fe3984e7671 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] attach device xml: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: Jul 05 03:33:03.080499 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:33:03.081083 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.117909 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.40.100,3260] Jul 05 03:33:03.117909 np0000004562 nova-compute[99148]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.40.100,3260] successful. Jul 05 03:33:03.117909 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.137063 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.148858 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.188452 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.50.100,3260] Jul 05 03:33:03.188452 np0000004562 nova-compute[99148]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7, portal: 192.168.50.100,3260] successful. Jul 05 03:33:03.188452 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] <== disconnect_volume: return (349ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Deleting instance files /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec_del Jul 05 03:33:03.214224 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Deletion of /opt/stack/data/nova/instances/a123d3ff-9f01-46b6-838c-11bc579124ec_del complete Jul 05 03:33:03.273840 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:03.468272 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 37710fe2-332b-40f8-818f-777113757600] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:03.718747 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:03.732664 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Took 1.76 seconds to destroy the instance on the hypervisor. Jul 05 03:33:03.737965 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:33:03.737965 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:33:03.737965 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:33:03.737965 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:03.816637 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:04.129194 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2cd0aaa4-8874-4946-b761-89bee44f7ae7 req-0e356d97-ed4c-47b5-9004-8c1b83de3255 service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Received event network-vif-deleted-e40e5ce9-251f-4286-a5e0-a38e2c1a8c05 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:04.129969 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-2cd0aaa4-8874-4946-b761-89bee44f7ae7 req-0e356d97-ed4c-47b5-9004-8c1b83de3255 service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Neutron deleted interface e40e5ce9-251f-4286-a5e0-a38e2c1a8c05; detaching it from the instance and deleting it from the info cache Jul 05 03:33:04.131024 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2cd0aaa4-8874-4946-b761-89bee44f7ae7 req-0e356d97-ed4c-47b5-9004-8c1b83de3255 service nova] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Detach interface failed, port_id=e40e5ce9-251f-4286-a5e0-a38e2c1a8c05, reason: Instance a123d3ff-9f01-46b6-838c-11bc579124ec could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:33:04.574862 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:04.769013 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:04.769119 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:04.769202 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:04.769312 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:19:0b:53, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:05.076798 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Took 1.34 seconds to deallocate network for instance. Jul 05 03:33:05.641195 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Took 0.56 seconds to detach 1 volumes for instance. Jul 05 03:33:05.643792 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Deleting volume: 9c8b0c2e-22d2-495f-95e7-3632d4841ab7 {{(pid=99148) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3457}} Jul 05 03:33:05.740505 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:06.193564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:06.194651 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:06.199521 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:06.199695 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:06.331521 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-64441323-cd08-4945-aecf-281903dfe92f tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.520s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:06.408586 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:06.473519 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Refreshing inventories for resource provider 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:821}} Jul 05 03:33:06.526165 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Updating ProviderTree inventory for provider 555a8dfa-6105-4c91-843c-764798128d3b from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:785}} Jul 05 03:33:06.526369 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Updating inventory in ProviderTree for provider 555a8dfa-6105-4c91-843c-764798128d3b with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 05 03:33:06.572416 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Refreshing aggregate associations for resource provider 555a8dfa-6105-4c91-843c-764798128d3b, aggregates: None {{(pid=99148) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:830}} Jul 05 03:33:06.627232 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Refreshing trait associations for resource provider 555a8dfa-6105-4c91-843c-764798128d3b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_STATELESS_FIRMWARE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_ARCH_X86_64,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ARCH_PPC64LE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41 {{(pid=99148) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:842}} Jul 05 03:33:06.702396 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid cc621bcb-52cf-4d0c-9df2-36b453b50c50 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:07.214658 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:07.214984 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:07.711856 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:07.718182 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:07.857500 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:08.225265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.026s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:08.287700 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Deleted allocations for instance a123d3ff-9f01-46b6-838c-11bc579124ec Jul 05 03:33:09.047056 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:09.047558 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:09.047558 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Attaching volume 4c04faaf-51aa-4375-9185-8fe3984e7671 to /dev/vdb Jul 05 03:33:09.089822 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:09.099866 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:33:09.118795 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:09.152291 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:33:09.152549 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:33:09.160339 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:33:09.161759 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94'] Jul 05 03:33:09.161878 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:33:09.161969 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:33:09.162195 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:09.162409 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updating existing volume attachment record: 8d7df580-e657-452b-b955-0ad2e75ad901 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:33:09.302681 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-5e82e4b5-a798-49ad-a682-f8e38760e5aa tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "a123d3ff-9f01-46b6-838c-11bc579124ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.842s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:09.722033 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:33:09.722450 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:09.722643 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:09.844447 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:10.046704 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00038479099998767197 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.046871 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.046967 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.000297307999971963 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.047122 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004577260001497052 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.047503 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.047503 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.239352639999879 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.047503 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.23927576799997 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:10.047796 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:10.048000 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] VM Stopped (Lifecycle Event) Jul 05 03:33:10.050049 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:10.050125 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] VM Stopped (Lifecycle Event) Jul 05 03:33:10.274808 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.552s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:10.275080 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:10.286827 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:10.288114 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:10.289414 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:10.289598 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:10.290383 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:10.290591 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:10.303071 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:10.307069 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:10.314647 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:10.321249 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:10.333905 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:10.334244 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:10.334485 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:10.334485 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:10.335435 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('7', '0', '0', 0) found on session 33 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:10.335435 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:10.341227 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:10.341634 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:10.342017 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:10.342350 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('8', '0', '0', 0) found on session 34 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:10.342462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:10.347943 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 33 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:10.348086 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:10.351149 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 34 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:10.351302 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:10.431793 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:10.432012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:10.432276 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:10.432456 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:10.432604 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:10.436466 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Terminating instance Jul 05 03:33:10.551874 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d9648240-d6cc-4c4f-9ab0-7947fbab3242 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: ef4ed455-c916-4565-9d4e-1b9fc9262b91] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:10.552704 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: 28b3c393-2575-4bb8-af24-988f514af885] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:10.942992 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:33:10.951999 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:10.967681 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.084804 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.248135 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999720731000025 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:11.249847 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Instance destroyed successfully. Jul 05 03:33:11.250359 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lazy-loading 'resources' on Instance uuid d22f1b3c-5d43-486e-a417-325d749fca25 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:11.291535 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:33:11.411898 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.752738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592721547',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverbootfromvolumestablerescuetest-server-592721547',id=2,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:30:26Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c3465ef2c67b48a5a9eeb4bea4ff9fff',ramdisk_id='',reservation_id='r-0ar0jo0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:36Z,user_data=None,user_id='87700afdc5b8465bb1fb235e2ebf6717',uuid=d22f1b3c-5d43-486e-a417-325d749fca25,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:33:11.752916 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converting VIF {"id": "a925ff58-8914-48a7-8301-62b925285161", "address": "fa:16:3e:1d:99:45", "network": {"id": "eef649b5-4a88-471b-917d-3eb64508ed5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2124164500-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c3465ef2c67b48a5a9eeb4bea4ff9fff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa925ff58-89", "ovs_interfaceid": "a925ff58-8914-48a7-8301-62b925285161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:11.753680 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:11.753951 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:33:11.780802 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.793150 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.809817 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.810034 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa925ff58-89, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:11.815139 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.816781 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:11.817634 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.817934 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f8210fe-2492-43ec-8c78-b074feadfab4) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:11.819408 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.820052 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:11.842786 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.846369 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:11.848469 np0000004562 nova-compute[99148]: INFO os_vif [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:99:45,bridge_name='br-int',has_traffic_filtering=True,id=a925ff58-8914-48a7-8301-62b925285161,network=Network(eef649b5-4a88-471b-917d-3eb64508ed5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa925ff58-89') Jul 05 03:33:11.848904 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Deleting instance files /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25_del Jul 05 03:33:11.849680 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Deletion of /opt/stack/data/nova/instances/d22f1b3c-5d43-486e-a417-325d749fca25_del complete Jul 05 03:33:11.948238 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:11.948421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:11.948658 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:11.948703 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:11.948864 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] No waiting events found dispatching network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:11.949000 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-49e2ab95-ac3a-41cc-a38e-7274276864ef req-e11bf48e-9c51-4e80-b14e-f46c16373d31 service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:33:12.310841 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 3300000002cadf234 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:33:12.311403 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:12.311403 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (2588ms) {'type': 'block', 'scsi_wwn': '3300000002cadf234', 'path': '/dev/dm-0', 'multipath_id': '3300000002cadf234'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:12.311403 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cadf234', 'path': '/dev/dm-0', 'multipath_id': '3300000002cadf234'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:33:12.319519 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid cc621bcb-52cf-4d0c-9df2-36b453b50c50 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:12.356304 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Took 1.41 seconds to destroy the instance on the hypervisor. Jul 05 03:33:12.357000 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:33:12.357314 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:33:12.357464 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:33:12.357762 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:12.503301 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:12.821238 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Attempting to attach volume 4c04faaf-51aa-4375-9185-8fe3984e7671 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] attach device xml: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: Jul 05 03:33:12.825372 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:33:13.351134 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:13.771018 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:13.853367 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Took 1.50 seconds to deallocate network for instance. Jul 05 03:33:14.028281 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:14.028493 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] Acquiring lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:14.028560 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:14.029017 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] Lock "d22f1b3c-5d43-486e-a417-325d749fca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:14.029017 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] No waiting events found dispatching network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:14.029132 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received unexpected event network-vif-unplugged-a925ff58-8914-48a7-8301-62b925285161 for instance with vm_state deleted and task_state None. Jul 05 03:33:14.029264 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3bb46b2e-84c7-44b3-a6f5-7fffb7061935 req-98e74f80-8bf1-42c5-9a2b-8a4c2852685c service nova] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Received event network-vif-deleted-a925ff58-8914-48a7-8301-62b925285161 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:14.360905 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:14.361297 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:14.501535 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:14.501690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:14.501816 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:14.501938 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:a0:5c:94, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:14.906932 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:14.907164 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:15.410396 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:15.917855 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.556s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:15.984232 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Deleted allocations for instance d22f1b3c-5d43-486e-a417-325d749fca25 Jul 05 03:33:16.073445 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd53b574-0996-474f-92d1-e60cc02fc60c tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.026s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:16.268743 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:16.268978 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:16.426865 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:16.711935 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:16.771984 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:16.819943 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:16.996011 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-37ffba0e-1c73-4828-890d-be8a469347cf tempest-ServerBootFromVolumeStableRescueTest-2049298576 tempest-ServerBootFromVolumeStableRescueTest-2049298576-project-member] Lock "d22f1b3c-5d43-486e-a417-325d749fca25" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.563s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:17.077864 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:17.078234 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:17.287278 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006354710001232888 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:17.289231 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:17.289231 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.958661219000078 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:17.289231 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.958590005999895 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:17.289950 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:17.290150 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] VM Stopped (Lifecycle Event) Jul 05 03:33:17.329591 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:17.330201 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:17.335738 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:17.335738 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Claim successful on node np0000004562 Jul 05 03:33:17.582997 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Detaching volume 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:17.640151 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 134dd22e-099b-4049-b8c3-8bbd75028bdf] Attempting to driver detach volume 4c04faaf-51aa-4375-9185-8fe3984e7671 from mountpoint /dev/vdb Jul 05 03:33:17.656454 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found disk vdb by alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:17.659281 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found disk vdb by alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:17.659374 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Attempting to detach device vdb from instance 134dd22e-099b-4049-b8c3-8bbd75028bdf from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] detach device xml: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]:
Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: Jul 05 03:33:17.659682 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:17.668415 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully detached device vdb from instance 134dd22e-099b-4049-b8c3-8bbd75028bdf from the persistent domain config. Jul 05 03:33:17.668616 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] (1/8): Attempting to detach device vdb with device alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 from instance 134dd22e-099b-4049-b8c3-8bbd75028bdf from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] detach device xml: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]:
Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: Jul 05 03:33:17.669055 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:17.795271 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de869901-39ba-4e8c-8e62-c0ddeffa05e3 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: a123d3ff-9f01-46b6-838c-11bc579124ec] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:18.322036 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-4c04faaf-51aa-4375-9185-8fe3984e7671> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:33:18.324302 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 for instance 134dd22e-099b-4049-b8c3-8bbd75028bdf {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:33:18.328841 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully detached device vdb from instance 134dd22e-099b-4049-b8c3-8bbd75028bdf from the live domain config. Jul 05 03:33:18.486974 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:18.880660 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Detected multiple connections on this host for volume: 4c04faaf-51aa-4375-9185-8fe3984e7671, skipping target disconnect. Jul 05 03:33:18.950604 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:19.030387 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:19.030610 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:19.459329 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 134dd22e-099b-4049-b8c3-8bbd75028bdf {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:19.535624 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:20.044082 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.714s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:20.044508 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:20.464486 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0dbacd69-4159-44f7-9eb3-fed19f969a4d tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "134dd22e-099b-4049-b8c3-8bbd75028bdf" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.386s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:20.552166 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:20.552921 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:20.552921 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:20.554691 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:20.565039 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:20.565112 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:20.640519 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eddbc1b720fd44d0b36e9f9759161a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe307c595da542e184ffe93fcfd11d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:21.054830 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:21.067731 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Detaching volume 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:21.102435 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Attempting to driver detach volume 4c04faaf-51aa-4375-9185-8fe3984e7671 from mountpoint /dev/vdb Jul 05 03:33:21.107855 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found disk vdb by alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found disk vdb by alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Attempting to detach device vdb from instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] detach device xml: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]:
Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: Jul 05 03:33:21.110160 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:21.114293 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully detached device vdb from instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 from the persistent domain config. Jul 05 03:33:21.114406 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] (1/8): Attempting to detach device vdb with device alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 from instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] detach device xml: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: 4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]:
Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: Jul 05 03:33:21.114634 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:21.320261 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Successfully created port: 4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:21.429122 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:21.556004 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:21.820283 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:21.912689 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Successfully updated port: 4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:21.973011 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-changed-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:21.973184 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Refreshing instance network info cache due to event network-changed-4787b095-1de4-45d3-aa33-7dff0fefecf7. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:21.973381 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] Acquiring lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:21.973506 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] Acquired lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:21.973888 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Refreshing network info cache for port 4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:22.415649 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:22.475916 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:22.557630 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:22.565244 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:22.566100 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:22.566304 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating image(s) Jul 05 03:33:22.566737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:22.566879 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:22.567351 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:22.567986 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:22.571747 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:22.575534 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:22.663258 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:22.663834 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:22.664270 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:22.665080 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:22.667726 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:22.668209 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:22.742385 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:22.843311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.175s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:22.843962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:22.892696 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk 1073741824" returned: 0 in 0.048s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:22.893066 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.229s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:22.893386 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:22.970690 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.077s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:22.971921 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:33:22.971921 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Cannot resize image /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:23.064738 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:23.245263 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6302ecfa-0173-4f2c-9a03-d7c10dcdc0d6 req-6915020a-a846-4537-adba-94ad43041bfd service nova] Releasing lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:23.246358 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquired lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:23.246358 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:23.803210 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:23.870909 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:23.871086 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:23.961303 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:24.015830 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:24.106219 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updating instance_info_cache with network_info: [{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:24.334395 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-4c04faaf-51aa-4375-9185-8fe3984e7671> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:33:24.336011 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4c04faaf-51aa-4375-9185-8fe3984e7671 for instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:33:24.339898 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully detached device vdb from instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 from the live domain config. Jul 05 03:33:24.373481 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:24.384077 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:33:24.387035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:24.387035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:24.387035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:24.387035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c04faaf-51aa-4375-9185-8fe3984e7671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:33:24.387035 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '34')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '33')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '34')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Resulting device map defaultdict(. at 0x7249b4386ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:33:24.421023 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flush multipath device 3300000002cadf234 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:33:24.458700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:24.517363 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:24.525989 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] instance snapshotting Jul 05 03:33:24.573937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:33:24.573937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:33:24.573937 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:33:24.584455 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:33:24.584932 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:33:24.596818 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.612214 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Releasing lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:24.614889 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance network_info: |[{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:24.614889 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Start _get_guest_xml network_info=[{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:24.618000 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:24.619330 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-954845619', uuid='7d3677fa-c41c-4c87-8991-c3d456184155'), owner=OwnerMeta(userid='eddbc1b720fd44d0b36e9f9759161a98', username='tempest-ServerActionsTestOtherA-1550935099-project-member', projectid='fe307c595da542e184ffe93fcfd11d4c', projectname='tempest-ServerActionsTestOtherA-1550935099'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222404.618978) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:24.619845 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Beginning live snapshot process Jul 05 03:33:24.622157 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:24.622644 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:24.623625 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:24.623883 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:24.624834 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:24.625367 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:24.625683 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:24.625967 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:24.626768 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:24.626768 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:24.627041 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:24.627514 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:24.627514 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:24.627745 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:24.628141 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:24.629767 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:24.637382 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.40.100,3260] Jul 05 03:33:24.637382 np0000004562 nova-compute[99148]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.40.100,3260] successful. Jul 05 03:33:24.637382 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.640895 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-954845619',display_name='tempest-tempest.common.compute-instance-954845619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-tempest-common-compute-instance-954845619',id=23,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQGJH6Ej6W7yzdG7fGEfKEAFkNPXac69Goq1okOM8dODI5oTfjFBBL49VbKxoD/uOIM9ZC18+NWdFwO7ke10RkhqjlnDjLwR4CATa3Wb41wRrAe1vo1F7I4u1/dBohHgw==',key_name='tempest-keypair-60264763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-n8b2fn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=7d3677fa-c41c-4c87-8991-c3d456184155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:24.641433 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:24.642188 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:24.642838 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:24.656289 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.673284 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.712398 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.50.100,3260] Jul 05 03:33:24.712398 np0000004562 nova-compute[99148]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671, portal: 192.168.50.100,3260] successful. Jul 05 03:33:24.712398 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.730738 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.730738 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:24.730738 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== disconnect_volume: return (342ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:24.730738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:33:24.931903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:24.931903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:24.934697 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:24.934985 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Claim successful on node np0000004562 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] End _get_guest_xml xml= Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: instance-00000017 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: tempest-tempest.common.compute-instance-954845619 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 2026-07-05 03:33:24 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: True Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: bare Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099-project-member Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: Jul 05 03:33:25.145567 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Preparing to wait for external event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-954845619',display_name='tempest-tempest.common.compute-instance-954845619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-tempest-common-compute-instance-954845619',id=23,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQGJH6Ej6W7yzdG7fGEfKEAFkNPXac69Goq1okOM8dODI5oTfjFBBL49VbKxoD/uOIM9ZC18+NWdFwO7ke10RkhqjlnDjLwR4CATa3Wb41wRrAe1vo1F7I4u1/dBohHgw==',key_name='tempest-keypair-60264763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-n8b2fn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=7d3677fa-c41c-4c87-8991-c3d456184155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:25.148394 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:25.148866 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.148911 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:25.149198 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:25.150155 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.150348 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77230b1-6b1c-50b7-b59d-ae1aa170498c', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:25.152598 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.152598 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:25.153185 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.155358 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.155515 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4787b095-1d, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:25.155898 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4787b095-1d, col_values=(('qos', UUID('db54d6d6-6c1c-4f41-8d4c-042e1c5d7b90')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:25.156097 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4787b095-1d, col_values=(('external_ids', {'iface-id': '4787b095-1de4-45d3-aa33-7dff0fefecf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:af:99', 'vm-uuid': '7d3677fa-c41c-4c87-8991-c3d456184155'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:25.157520 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.158642 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:25.164369 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.171687 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.184164 np0000004562 nova-compute[99148]: INFO os_vif [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') Jul 05 03:33:25.206257 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.212596 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.286479 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid cc621bcb-52cf-4d0c-9df2-36b453b50c50 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:25.330841 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:25.332550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:26.144338 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:26.233442 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:26.233936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json -f qcow2 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:26.251172 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0032059529999060032 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:26.252109 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:26.253835 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:26.254308 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] VM Stopped (Lifecycle Event) Jul 05 03:33:26.266916 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:26.267426 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:26.269949 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:26.270979 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:26.271240 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No event matching network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 in dict_keys([('network-vif-plugged', '4787b095-1de4-45d3-aa33-7dff0fefecf7')]) {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 05 03:33:26.271612 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-8428ecf1-bdfa-4b40-9b6f-bc34765409b3 req-31d1a12f-3983-4549-8ea5-f83cc0424159 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state building and task_state spawning. Jul 05 03:33:26.294646 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-6736f21f-3f28-4ecb-aafd-6145716d2023 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "cc621bcb-52cf-4d0c-9df2-36b453b50c50" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.729s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:26.323489 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:26.324060 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:26.326799 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:26.327120 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:26.411893 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:26.412236 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be.delta 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:26.437510 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:26.471070 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be.delta 1073741824" returned: 0 in 0.059s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:26.472120 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Quiescing instance not available: QEMU guest agent is not enabled. Jul 05 03:33:26.612212 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:26.612559 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:26.634397 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:26.634596 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:26.699533 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:26.699702 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:26.699829 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No VIF found with MAC fa:16:3e:a3:af:99, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:26.700384 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Using config drive Jul 05 03:33:26.737082 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=99148) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 05 03:33:26.772518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-42f384a1-bdf3-40ca-8dcf-b011ca11ddb5 tempest-ServersNegativeTestJSON-789470158 tempest-ServersNegativeTestJSON-789470158-project-member] [instance: d22f1b3c-5d43-486e-a417-325d749fca25] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:27.116681 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:27.136888 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Detaching volume edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:33:27.171932 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Attempting to driver detach volume edafe60a-44d7-43ef-983e-c5e6a199b431 from mountpoint /dev/vdb Jul 05 03:33:27.175105 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Found disk vdb by alias ua-edafe60a-44d7-43ef-983e-c5e6a199b431 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:27.176041 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Found disk vdb by alias ua-edafe60a-44d7-43ef-983e-c5e6a199b431 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:33:27.176148 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Attempting to detach device vdb from instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] detach device xml: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]:
Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: Jul 05 03:33:27.176352 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:27.181851 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully detached device vdb from instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 from the persistent domain config. Jul 05 03:33:27.181966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] (1/8): Attempting to detach device vdb with device alias ua-edafe60a-44d7-43ef-983e-c5e6a199b431 from instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] detach device xml: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]:
Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: Jul 05 03:33:27.182181 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:33:27.209541 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:27.239531 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=99148) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 05 03:33:27.241147 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 05 03:33:27.294329 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:33:27.294768 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be.delta /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:27.374773 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating config drive at /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config Jul 05 03:33:27.379815 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmk7exiz6 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:27.428940 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmk7exiz6" returned: 0 in 0.049s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:27.546950 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be.delta /opt/stack/data/nova/instances/snapshots/tmp515eb1nm/51b439e37b2c4695a310b57a689b12be" returned: 0 in 0.252s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:27.551681 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Snapshot extracted, beginning image upload Jul 05 03:33:27.626787 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.695s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:27.629656 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:27.988394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-edafe60a-44d7-43ef-983e-c5e6a199b431> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:33:27.991848 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-edafe60a-44d7-43ef-983e-c5e6a199b431 for instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:33:27.993634 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:27.993957 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:28.003034 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully detached device vdb from instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 from the live domain config. Jul 05 03:33:28.006473 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:33:28.006846 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:28.007003 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:28.007374 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:28.007735 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edafe60a-44d7-43ef-983e-c5e6a199b431', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:33:28.007880 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:33:28.014569 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:28.014569 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:28.030169 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:28.030169 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:28.030169 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:28.030169 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:28.030169 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:28.030304 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:28.030304 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:28.030304 np0000004562 nova-compute[99148]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:28.030304 np0000004562 nova-compute[99148]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:28.030304 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:28.030392 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:33:28.030506 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:28.031763 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:28.032512 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Resulting device map defaultdict(. at 0x7249ac77f600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'): ({'sdf'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:33:28.032731 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Removing multipathed devices sdf, sdg {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:33:28.033173 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Flush multipath device 330000000a2ed4bb7 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:33:28.078880 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:28.121217 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:28.138135 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:28.138373 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:28.138755 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:28.139302 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:28.169290 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:33:28.169570 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:33:28.170677 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:33:28.187116 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:33:28.187423 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:33:28.199881 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.226283 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e352bca5045491e9822ecc25b5ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46eb0f51c1c14cd59248f83bc46d358a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:28.235940 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.40.100,3260] Jul 05 03:33:28.235940 np0000004562 nova-compute[99148]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.40.100,3260] successful. Jul 05 03:33:28.235940 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.250319 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.261068 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.302336 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.50.100,3260] Jul 05 03:33:28.302336 np0000004562 nova-compute[99148]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431, portal: 192.168.50.100,3260] successful. Jul 05 03:33:28.302336 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.315005 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:28.315354 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:28.315541 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] <== disconnect_volume: return (308ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:28.315738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:33:28.324369 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:28.324694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:28.324946 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:28.325132 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:28.325249 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Processing event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:28.325387 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:28.325549 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:28.325694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:28.326004 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:28.326194 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No waiting events found dispatching network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:28.326340 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-208df672-b5b2-4693-bb86-359327eeb8c0 req-3a9b12d0-005b-42da-b4ea-151163a3994b service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state building and task_state spawning. Jul 05 03:33:28.498256 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:28.638435 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:28.787240 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Successfully created port: 51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:28.900626 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'flavor' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:28.957005 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:28.958108 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:28.958282 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Started (Lifecycle Event) Jul 05 03:33:28.961741 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:28.966972 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance spawned successfully. Jul 05 03:33:28.967482 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:29.057330 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:29.057644 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:29.061067 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:29.061273 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Claim successful on node np0000004562 Jul 05 03:33:29.149296 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:29.362226 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Successfully updated port: 51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:29.465880 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:29.467674 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.476739 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:29.865496 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:29.865691 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquired lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:29.866019 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:29.909635 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-bc2b45c6-0d22-435e-a26d-5cfe021f1cd3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.274s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:29.973160 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:33:29.973429 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:29.973635 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Paused (Lifecycle Event) Jul 05 03:33:29.982170 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Took 7.42 seconds to spawn the instance on the hypervisor. Jul 05 03:33:29.982373 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:30.160746 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:30.160746 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:30.165776 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:30.168732 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Creating image(s) Jul 05 03:33:30.168732 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:30.169095 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "/opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:30.170082 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "/opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:30.170633 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:30.174054 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:30.175090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:30.261931 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:30.262476 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:30.263106 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:30.263554 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:30.266609 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:30.267138 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:30.349612 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.082s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:30.350057 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:30.395894 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk 1073741824" returned: 0 in 0.045s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:30.396742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.133s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:30.397179 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:30.441065 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-changed-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:30.441065 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing instance network info cache due to event network-changed-51b60f96-a9a7-4241-95fb-8a670a49ea41. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:30.441065 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] Acquiring lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:30.466585 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Snapshot image upload complete Jul 05 03:33:30.466845 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4da9992e-653e-45e3-b8ae-674605cbbd7e tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Took 5.94 seconds to snapshot the instance on the hypervisor. Jul 05 03:33:30.478662 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:30.483823 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:30.483977 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Resumed (Lifecycle Event) Jul 05 03:33:30.507537 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:30.511021 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.114s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:30.516614 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Took 13.24 seconds to build instance. Jul 05 03:33:30.524318 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:33:30.525668 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:30.629311 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:30.630248 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Cannot resize image /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:33:30.630248 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:30.630863 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Ensure instance console log exists: /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:30.631140 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:30.631526 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:30.631526 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:30.756671 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:30.921902 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating instance_info_cache with network_info: [{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:30.924816 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:30.925066 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:30.988233 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:30.990408 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:31.048339 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-05a065a1-24d0-42a5-86c3-6bde195a45b4 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.779s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:31.061378 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:31.061578 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:31.061808 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:31.061933 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:31.062044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:31.064287 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Terminating instance Jul 05 03:33:31.424034 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Releasing lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:31.424417 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Instance network_info: |[{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:31.427834 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Start _get_guest_xml network_info=[{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:31.427834 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] Acquired lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:31.428994 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing network info cache for port 51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:31.430508 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:31.437727 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:31.438732 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1990495923', uuid='86e756d2-be55-4c56-9c4c-0cba5eedc592'), owner=OwnerMeta(userid='5e352bca5045491e9822ecc25b5ff38e', username='tempest-TaggedAttachmentsTest-1679654348-project-member', projectid='46eb0f51c1c14cd59248f83bc46d358a', projectname='tempest-TaggedAttachmentsTest-1679654348'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222411.4383702) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:31.439925 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:31.440122 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:31.441303 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:31.441537 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:31.442601 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:31.442936 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:31.443098 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:31.443169 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:31.443284 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:31.443369 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:31.443567 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:31.443677 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:31.448345 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:31.448345 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:31.448345 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:31.448345 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:31.458134 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.464077 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1990495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1990495923',id=24,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJmvibn5BkLSUlJMsgt1RKvuVGfG7uZnvd4JXoCby+3TWg+md0gz1ND9h+rR2uzgIYiZIX0Rl4AR9J1f17jaT0Nt3tT83TEtSKmG3b2uTO8rhzAO0Jgb65pkV/Ln68Usg==',key_name='tempest-keypair-820072378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46eb0f51c1c14cd59248f83bc46d358a',ramdisk_id='',reservation_id='r-91d27z59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1679654348',owner_user_name='tempest-TaggedAttachmentsTest-1679654348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e352bca5045491e9822ecc25b5ff38e',uuid=86e756d2-be55-4c56-9c4c-0cba5eedc592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:31.464363 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converting VIF {"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:31.465799 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9e:58,bridge_name='br-int',has_traffic_filtering=True,id=51b60f96-a9a7-4241-95fb-8a670a49ea41,network=Network(57b29a0c-3e81-447e-8050-23a92988186a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b60f96-a9') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:31.465799 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:31.571987 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:33:31.577317 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.585662 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.901504 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999730580000005 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:31.903077 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998121060999893 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:31.903489 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997877678999885 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:31.903743 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Instance destroyed successfully. Jul 05 03:33:31.904121 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:31.936727 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:31.940654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.880s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:31.941398 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] End _get_guest_xml xml= Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: instance-00000018 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: tempest-device-tagging-server-1990495923 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 2026-07-05 03:33:31 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: True Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: bare Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348-project-member Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: Jul 05 03:33:31.970279 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:31.974156 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Preparing to wait for external event network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:31.974156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:31.974156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:31.974156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:31.974817 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1990495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1990495923',id=24,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJmvibn5BkLSUlJMsgt1RKvuVGfG7uZnvd4JXoCby+3TWg+md0gz1ND9h+rR2uzgIYiZIX0Rl4AR9J1f17jaT0Nt3tT83TEtSKmG3b2uTO8rhzAO0Jgb65pkV/Ln68Usg==',key_name='tempest-keypair-820072378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46eb0f51c1c14cd59248f83bc46d358a',ramdisk_id='',reservation_id='r-91d27z59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1679654348',owner_user_name='tempest-TaggedAttachmentsTest-1679654348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e352bca5045491e9822ecc25b5ff38e',uuid=86e756d2-be55-4c56-9c4c-0cba5eedc592,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:31.975059 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converting VIF {"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:31.975922 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9e:58,bridge_name='br-int',has_traffic_filtering=True,id=51b60f96-a9a7-4241-95fb-8a670a49ea41,network=Network(57b29a0c-3e81-447e-8050-23a92988186a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b60f96-a9') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:31.976178 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9e:58,bridge_name='br-int',has_traffic_filtering=True,id=51b60f96-a9a7-4241-95fb-8a670a49ea41,network=Network(57b29a0c-3e81-447e-8050-23a92988186a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b60f96-a9') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:31.979850 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.979850 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:31.979850 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:31.983188 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.983452 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1278c53c-608a-5d36-8492-c13d008d23c2', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:31.984753 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.985663 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:31.988488 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.988688 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b60f96-a9, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:31.989555 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51b60f96-a9, col_values=(('qos', UUID('30ae4a84-3eac-43ff-9d97-ae59e30ce424')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:31.989746 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51b60f96-a9, col_values=(('external_ids', {'iface-id': '51b60f96-a9a7-4241-95fb-8a670a49ea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:9e:58', 'vm-uuid': '86e756d2-be55-4c56-9c4c-0cba5eedc592'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:31.990624 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:31.991986 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:31.998192 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.006381 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.018106 np0000004562 nova-compute[99148]: INFO os_vif [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9e:58,bridge_name='br-int',has_traffic_filtering=True,id=51b60f96-a9a7-4241-95fb-8a670a49ea41,network=Network(57b29a0c-3e81-447e-8050-23a92988186a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b60f96-a9') Jul 05 03:33:32.042946 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.049942 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.173969 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-changed-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:32.174192 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Refreshing instance network info cache due to event network-changed-4787b095-1de4-45d3-aa33-7dff0fefecf7. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:32.174360 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] Acquiring lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:32.174494 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] Acquired lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:32.174637 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Refreshing network info cache for port 4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:32.243375 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:32.243829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:32.401284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.404659 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.407604 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-561721903',display_name='tempest-ServerRescueNegativeTestJSON-server-561721903',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-561721903',id=14,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5C1PD7kMqh+7KVuuShtRFCyVUOnOd/2IlikAG4AzRLIo5GTkr7ifn9Wd/Ybwxq52FR0i5LiFl0RT1NSP3Zf/7oDmhZv5cJa8w5AI2yZF3+uyyVWgxfGq6Z+37o9w5PRQ==',key_name='tempest-keypair-651564886',keypairs=,launch_index=0,launched_at=2026-07-05T03:32:42Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-exzz2q3m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:33:32.407888 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "ae99d539-260e-4455-b60f-28b27e1002a8", "address": "fa:16:3e:73:41:ed", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae99d539-26", "ovs_interfaceid": "ae99d539-260e-4455-b60f-28b27e1002a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:32.408384 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:32.408384 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:33:32.410236 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.432234 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.440330 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.448757 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:32.448757 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:32.449090 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:32.449090 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:32.458572 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:32.460727 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.460802 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.468512 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae99d539-26, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:32.469404 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.470457 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:32.482741 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.487146 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.488546 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.488810 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f262072-176b-4f92-9052-e2d294a28fa9) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:32.491321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.492333 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:32.495164 np0000004562 nova-compute[99148]: INFO os_vif [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:41:ed,bridge_name='br-int',has_traffic_filtering=True,id=ae99d539-260e-4455-b60f-28b27e1002a8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae99d539-26') Jul 05 03:33:32.495612 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Deleting instance files /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585_del Jul 05 03:33:32.496498 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Deletion of /opt/stack/data/nova/instances/7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585_del complete Jul 05 03:33:32.504224 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8b1b57c7-cced-4020-95c8-3a7e0c4f12a2 req-937aded1-bc3c-4a0f-a408-6bc575e7f2b0 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:32.504991 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8b1b57c7-cced-4020-95c8-3a7e0c4f12a2 req-937aded1-bc3c-4a0f-a408-6bc575e7f2b0 service nova] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:32.505400 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8b1b57c7-cced-4020-95c8-3a7e0c4f12a2 req-937aded1-bc3c-4a0f-a408-6bc575e7f2b0 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:32.505556 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8b1b57c7-cced-4020-95c8-3a7e0c4f12a2 req-937aded1-bc3c-4a0f-a408-6bc575e7f2b0 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:32.505730 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8b1b57c7-cced-4020-95c8-3a7e0c4f12a2 req-937aded1-bc3c-4a0f-a408-6bc575e7f2b0 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Processing event network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:32.582955 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13eaeef1f2334d698ac49202f06873c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef60743c71546fc87af8540e17c0506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:32.653120 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updated VIF entry in instance network info cache for port 51b60f96-a9a7-4241-95fb-8a670a49ea41. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:32.653513 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating instance_info_cache with network_info: [{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:32.685852 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:32.695210 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:32.742646 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:32.743527 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:32.746866 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'flavor' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:32.961080 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:33.010281 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Took 1.44 seconds to destroy the instance on the hypervisor. Jul 05 03:33:33.010984 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:33:33.013860 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:33:33.013941 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:33:33.014150 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:33.076909 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:33.117470 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:33.156283 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-2a7df70d-4e04-4338-9452-fd530079ba69 req-bd1d1383-bb6f-4ae5-ad21-acc758d62826 service nova] Releasing lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:33.218471 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Successfully created port: e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:33.245608 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:33.273328 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updated VIF entry in instance network info cache for port 4787b095-1de4-45d3-aa33-7dff0fefecf7. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:33.274241 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updating instance_info_cache with network_info: [{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:33.466745 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:33.551053 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:33.551053 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:33.551053 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No VIF found with MAC fa:16:3e:7c:9e:58, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:33.551053 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Using config drive Jul 05 03:33:33.752856 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:33.776694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7871f10b-6b25-4c29-914f-1b01a9433861 req-286e1a73-e39b-424e-8b6c-97eff337c1a1 service nova] Releasing lock "refresh_cache-7d3677fa-c41c-4c87-8991-c3d456184155" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:33.817326 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:33.817595 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:33.821233 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:33.821331 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Claim successful on node np0000004562 Jul 05 03:33:33.826291 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Successfully updated port: e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:33.884450 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:33.885198 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing instance network info cache due to event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:33.885343 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:33.885430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:33.885531 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing network info cache for port e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:34.059795 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:34.119786 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:34.176810 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Creating config drive at /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.config Jul 05 03:33:34.181607 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zswf55o {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.230414 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zswf55o" returned: 0 in 0.048s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] No waiting events found dispatching network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Acquiring lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] No waiting events found dispatching network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:34.243944 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-1a611a70-74f5-43a6-bdb0-8d862aff606a req-074aea94-6a54-439f-be50-e40f463020ab service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-unplugged-ae99d539-260e-4455-b60f-28b27e1002a8 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:33:34.330745 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:34.388111 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:34.473733 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:34.475160 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:34.475416 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Creating image(s) Jul 05 03:33:34.476132 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.476315 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.477064 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.479162 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:34.483353 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:34.485053 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:34.487511 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.568724 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:34.569298 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.569490 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.569646 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.569799 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] No waiting events found dispatching network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:34.569935 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received unexpected event network-vif-plugged-51b60f96-a9a7-4241-95fb-8a670a49ea41 for instance with vm_state building and task_state spawning. Jul 05 03:33:34.570028 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-5547d566-9bfb-4d8e-b51a-bd73563f6c3a req-1300207b-51ae-4413-be7f-ba159596b52f service nova] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Received event network-vif-deleted-ae99d539-260e-4455-b60f-28b27e1002a8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:34.574179 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.574593 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.574979 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.575395 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:34.578768 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:34.579292 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.622170 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Took 1.61 seconds to deallocate network for instance. Jul 05 03:33:34.656451 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:34.658903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.079s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.659071 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:34.660090 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.692293 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:34.718435 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk 1073741824" returned: 0 in 0.059s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.718931 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.144s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.719325 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.810186 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.810657 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:33:34.812505 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.828961 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.829246 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.829618 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attaching volume 089a0fef-69ed-4d40-82af-e702bd977251 to /dev/vdb Jul 05 03:33:34.891662 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:34.903029 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Cannot resize image /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Ensure instance console log exists: /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:34.905281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:34.905519 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:34.924356 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:34.967557 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:33:34.968205 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:33:34.977658 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:33:34.978869 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fea3:af99', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a'] Jul 05 03:33:34.979000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:33:34.979000 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:33:34.979209 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:34.979418 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating existing volume attachment record: 62f066ea-90b6-4468-8a14-21ff4e88f21b {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:33:35.128938 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:35.195918 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-de48760e-e5ec-4675-8057-c830517d5b5a req-f19513df-3f20-4650-bb6b-0be75fdc9e82 service nova] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:35.196407 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:35.196588 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:35.447732 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:35.447732 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:35.447732 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] VM Started (Lifecycle Event) Jul 05 03:33:35.452296 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:35.455694 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Instance spawned successfully. Jul 05 03:33:35.455956 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:35.505134 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:35.505533 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:35.535017 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:33:35.535311 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:35.535468 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:35.535960 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:35.536054 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:35.548928 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:35.549921 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:35.550159 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:35.550770 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:35.551270 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:35.551440 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:35.565018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:35.565018 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:35.569594 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:35.569594 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251] added Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:35.578306 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:35.578653 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:35.578801 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:35.578976 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251] added Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:35.582931 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:35.583169 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:35.583306 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:35.583481 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:35.779650 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:35.930423 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:35.953637 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:35.955692 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:35.961835 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:35.961991 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:35.962381 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:35.962680 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:35.963027 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:35.963361 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:36.008850 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:36.071326 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:36.444450 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:36.460629 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:33:36.460845 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:36.460951 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] VM Paused (Lifecycle Event) Jul 05 03:33:36.469994 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Took 6.31 seconds to spawn the instance on the hypervisor. Jul 05 03:33:36.469994 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:36.517193 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.699s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:36.518284 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.389s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:36.518432 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:36.575193 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:36.575683 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance network_info: |[{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:36.577296 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Start _get_guest_xml network_info=[{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:36.578869 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:36.579893 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='22ef7527-b9d6-4fde-aefc-20c4e4a0271b'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222416.5796008) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:36.580391 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:36.580875 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:36.581350 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:36.583605 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:36.583990 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:36.584354 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:36.585326 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:36.585689 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:36.585866 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:36.585963 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:36.586110 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:36.586198 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:36.586316 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:36.586474 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:36.586618 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:36.586768 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:36.586909 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:36.587085 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:36.599072 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=25,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-bk092nur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=22ef7527-b9d6-4fde-aefc-20c4e4a0271b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:36.599308 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:36.599802 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:36.600318 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'pci_devices' on Instance uuid 22ef7527-b9d6-4fde-aefc-20c4e4a0271b {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:36.602470 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:36.605431 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.617550 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.623359 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.634273 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.634273 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.634273 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.634273 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.634273 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:36.634587 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.634587 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.634587 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.634587 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.634587 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:36.643323 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.643323 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.643323 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.643323 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.643323 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:36.643508 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.643508 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.643508 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.643508 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.643508 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:36.668418 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.40.100,3260] Jul 05 03:33:36.668418 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.40.100,3260] successful. Jul 05 03:33:36.668418 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.684171 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.696162 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.50.100,3260] Jul 05 03:33:36.696162 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.50.100,3260] successful. Jul 05 03:33:36.696162 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.701143 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:36.701451 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:36.701690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:36.702277 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] HCTL ('11', '-', '-', 0) found on session 39 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:36.702378 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:36.709897 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:36.722126 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching for a device in session 39 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:36.722279 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.727815 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:36.728024 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:36.728257 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:36.728367 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:36.732048 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] HCTL ('12', '-', '-', 0) found on session 40 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:36.732177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:36.751974 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:36.751974 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:36.964584 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:36.967126 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:36.967329 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] VM Resumed (Lifecycle Event) Jul 05 03:33:36.981854 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Took 12.10 seconds to build instance. Jul 05 03:33:37.029174 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:37.029950 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:37.030192 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:37.030387 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] End _get_guest_xml xml= Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: instance-00000019 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: multiattach-server-0 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 2026-07-05 03:33:36 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: True Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: bare Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: Jul 05 03:33:37.107652 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Preparing to wait for external event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=25,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-bk092nur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=22ef7527-b9d6-4fde-aefc-20c4e4a0271b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:37.109690 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:37.110278 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:37.110657 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:37.110911 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.112222 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43de71339d8b4e3c957a35852444cf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd501ff4cdb7245fba675291a98ccb926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:37.113388 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:37.113695 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:37.118756 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.118948 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63815119-ef68-59be-92c6-60c9758f84d7', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:37.119708 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.120452 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:37.120966 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.123793 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.124092 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape425a405-5f, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:37.124431 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape425a405-5f, col_values=(('qos', UUID('ac2ee4b5-a923-4165-becb-35da0891b100')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:37.124643 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape425a405-5f, col_values=(('external_ids', {'iface-id': 'e425a405-5f9f-4291-953d-7cc71b8e3c7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:87:e9', 'vm-uuid': '22ef7527-b9d6-4fde-aefc-20c4e4a0271b'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:37.125665 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.126749 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:37.131675 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.137487 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.148227 np0000004562 nova-compute[99148]: INFO os_vif [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') Jul 05 03:33:37.176966 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.180531 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.350606 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:37.377279 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-567ec515-6c34-4325-a402-d712c0f97cef req-7f2dfb99-4df8-4ee3-8c7b-3e5c95ddb9da service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:37.377737 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-567ec515-6c34-4325-a402-d712c0f97cef req-7f2dfb99-4df8-4ee3-8c7b-3e5c95ddb9da service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:37.377941 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-567ec515-6c34-4325-a402-d712c0f97cef req-7f2dfb99-4df8-4ee3-8c7b-3e5c95ddb9da service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:37.378089 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-567ec515-6c34-4325-a402-d712c0f97cef req-7f2dfb99-4df8-4ee3-8c7b-3e5c95ddb9da service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:37.378232 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-567ec515-6c34-4325-a402-d712c0f97cef req-7f2dfb99-4df8-4ee3-8c7b-3e5c95ddb9da service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Processing event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:37.390835 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:37.391082 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:37.469887 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:37.473554 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:37.485728 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-0f290aa0-0001-4940-8a64-047c566f10e1 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.615s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:37.533199 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:37.552053 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:33:37.781482 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Successfully created port: b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:37.894085 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:38.036074 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:38.369172 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Successfully updated port: b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:38.401997 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.884s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:38.457467 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Deleted allocations for instance 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585 Jul 05 03:33:38.526870 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-changed-51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:38.527056 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing instance network info cache due to event network-changed-51b60f96-a9a7-4241-95fb-8a670a49ea41. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:38.527631 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] Acquiring lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:38.527784 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] Acquired lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:38.527972 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing network info cache for port 51b60f96-a9a7-4241-95fb-8a670a49ea41 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:38.568604 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Found WWN 3300000001935b047 for multipath device dm-4 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:33:38.569040 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:38.569093 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000001935b047', 'path': '/dev/dm-4', 'multipath_id': '3300000001935b047'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:38.569204 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001935b047', 'path': '/dev/dm-4', 'multipath_id': '3300000001935b047'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:33:38.573157 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'flavor' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:38.677340 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:38.677477 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:38.677560 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:9a:87:e9, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:38.677963 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Using config drive Jul 05 03:33:38.872028 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:38.872167 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquired lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:38.872310 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:39.032938 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:39.046169 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:39.047074 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:39.047291 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Creating image(s) Jul 05 03:33:39.047686 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:39.047842 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "/opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:39.048280 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "/opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:39.048800 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:39.051865 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:39.052872 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.083165 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attempting to attach volume 089a0fef-69ed-4d40-82af-e702bd977251 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] attach device xml: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: 089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: Jul 05 03:33:39.087149 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:33:39.148097 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.149411 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:39.149870 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:39.150236 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:39.153271 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:39.153654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.191324 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:39.247439 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.094s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.248756 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.309434 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk 1073741824" returned: 0 in 0.060s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.312538 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.160s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:39.312538 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.390523 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Creating config drive at /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config Jul 05 03:33:39.396014 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph3j28aq3 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.409786 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.097s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.413663 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:33:39.414610 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:39.458605 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:39.458605 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:39.458605 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:39.458605 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:39.458605 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] No waiting events found dispatching network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:39.458894 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received unexpected event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a for instance with vm_state building and task_state spawning. Jul 05 03:33:39.461970 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Received event network-changed-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:39.462120 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Refreshing instance network info cache due to event network-changed-b6ede3d6-5700-4ccb-9857-9c232d40ad3c. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:39.462285 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Acquiring lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:39.466539 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c449d57a-57b4-409b-b955-8b22d99f6776 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.405s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:39.471828 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph3j28aq3" returned: 0 in 0.071s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.503007 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:39.511582 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:39.513421 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:39.514749 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Cannot resize image /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:33:39.515639 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:39.515639 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:39.516137 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:39.516351 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:39.516492 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:39.698076 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:39.702729 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updated VIF entry in instance network info cache for port 51b60f96-a9a7-4241-95fb-8a670a49ea41. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:39.702988 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating instance_info_cache with network_info: [{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:39.863080 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updating instance_info_cache with network_info: [{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:39.929517 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:39.940224 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.206505 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3b684141-689a-4450-b609-59840d4e9672 req-2afc010b-856b-46b0-af80-31a24389c2df service nova] Releasing lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:40.365630 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Releasing lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:40.366012 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Instance network_info: |[{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:40.366540 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Acquired lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:40.368295 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Start _get_guest_xml network_info=[{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:40.368679 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Refreshing network info cache for port b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:40.371496 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:40.372803 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1445079770', uuid='fcd1b284-0f6d-4a08-8d63-10328b665f2c'), owner=OwnerMeta(userid='43de71339d8b4e3c957a35852444cf52', username='tempest-VolumesSnapshotTestJSON-1023273812-project-member', projectid='d501ff4cdb7245fba675291a98ccb926', projectname='tempest-VolumesSnapshotTestJSON-1023273812'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222420.3723924) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:40.373970 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:40.374285 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:40.375194 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:40.375373 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:40.376320 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:40.376644 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:40.376815 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:40.376911 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:40.377029 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:40.377110 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:40.377352 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:40.377629 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:40.377963 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:40.378101 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:40.378352 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:40.378863 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:40.390433 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1445079770',display_name='tempest-VolumesSnapshotTestJSON-instance-1445079770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumessnapshottestjson-instance-1445079770',id=26,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsz2Xf7OYjRKIz4fK8E5Ei8fFGGpOlHhDzVIWh3wW+8rl4nCFsGIwivZGAorHufz4Ysn8c0NkVyDw4Bghhi/uoEI6SHB1NTf21V0bLRoCdchWhBB/JLkYZLCfxy67Ojzg==',key_name='tempest-keypair-1813482790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d501ff4cdb7245fba675291a98ccb926',ramdisk_id='',reservation_id='r-4xohy3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1023273812',owner_user_name='tempest-VolumesSnapshotTestJSON-1023273812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43de71339d8b4e3c957a35852444cf52',uuid=fcd1b284-0f6d-4a08-8d63-10328b665f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:40.390884 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Converting VIF {"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:40.391523 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:92:10,bridge_name='br-int',has_traffic_filtering=True,id=b6ede3d6-5700-4ccb-9857-9c232d40ad3c,network=Network(752377e9-d6fa-4942-9906-f1086218e248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ede3d6-57') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:40.392190 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd1b284-0f6d-4a08-8d63-10328b665f2c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:40.616078 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:40.616254 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:40.702631 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:40.703289 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:40.703461 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] VM Started (Lifecycle Event) Jul 05 03:33:40.705850 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:40.708267 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance spawned successfully. Jul 05 03:33:40.708630 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:40.795103 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:40.795276 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:40.795276 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:40.795387 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No VIF found with MAC fa:16:3e:b8:52:56, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:40.870984 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] End _get_guest_xml xml= Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: fcd1b284-0f6d-4a08-8d63-10328b665f2c Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: instance-0000001a Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: tempest-VolumesSnapshotTestJSON-instance-1445079770 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 2026-07-05 03:33:40 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: True Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: bare Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: tempest-VolumesSnapshotTestJSON-1023273812-project-member Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: tempest-VolumesSnapshotTestJSON-1023273812 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: fcd1b284-0f6d-4a08-8d63-10328b665f2c Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: fcd1b284-0f6d-4a08-8d63-10328b665f2c Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: Jul 05 03:33:40.895103 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:40.897061 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Preparing to wait for external event network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:40.897061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:40.897061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:40.897061 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:40.897061 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1445079770',display_name='tempest-VolumesSnapshotTestJSON-instance-1445079770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-volumessnapshottestjson-instance-1445079770',id=26,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsz2Xf7OYjRKIz4fK8E5Ei8fFGGpOlHhDzVIWh3wW+8rl4nCFsGIwivZGAorHufz4Ysn8c0NkVyDw4Bghhi/uoEI6SHB1NTf21V0bLRoCdchWhBB/JLkYZLCfxy67Ojzg==',key_name='tempest-keypair-1813482790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d501ff4cdb7245fba675291a98ccb926',ramdisk_id='',reservation_id='r-4xohy3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1023273812',owner_user_name='tempest-VolumesSnapshotTestJSON-1023273812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43de71339d8b4e3c957a35852444cf52',uuid=fcd1b284-0f6d-4a08-8d63-10328b665f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:40.897299 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Converting VIF {"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:40.897555 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:92:10,bridge_name='br-int',has_traffic_filtering=True,id=b6ede3d6-5700-4ccb-9857-9c232d40ad3c,network=Network(752377e9-d6fa-4942-9906-f1086218e248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ede3d6-57') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:40.897960 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:92:10,bridge_name='br-int',has_traffic_filtering=True,id=b6ede3d6-5700-4ccb-9857-9c232d40ad3c,network=Network(752377e9-d6fa-4942-9906-f1086218e248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ede3d6-57') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:40.898520 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.898801 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:40.899022 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:40.901990 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.902189 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '215b759a-fcfa-570d-bb9f-d1f058290332', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:40.903166 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.903706 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:40.907160 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.910574 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.910808 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6ede3d6-57, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:40.911091 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6ede3d6-57, col_values=(('qos', UUID('8652830c-b58c-4fe2-a060-5d2d0979d6a5')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:40.911229 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6ede3d6-57, col_values=(('external_ids', {'iface-id': 'b6ede3d6-5700-4ccb-9857-9c232d40ad3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:92:10', 'vm-uuid': 'fcd1b284-0f6d-4a08-8d63-10328b665f2c'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:40.912786 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.913937 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:40.919460 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.930154 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:40.934775 np0000004562 nova-compute[99148]: INFO os_vif [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:92:10,bridge_name='br-int',has_traffic_filtering=True,id=b6ede3d6-5700-4ccb-9857-9c232d40ad3c,network=Network(752377e9-d6fa-4942-9906-f1086218e248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ede3d6-57') Jul 05 03:33:40.974997 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.118051 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:41.171344 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bcb5f561-8030-4fda-adad-4fc0a0bde213 req-b46753b5-d44b-47ca-acf6-06857f2d67f5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Received event network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:41.171499 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bcb5f561-8030-4fda-adad-4fc0a0bde213 req-b46753b5-d44b-47ca-acf6-06857f2d67f5 service nova] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:41.171627 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bcb5f561-8030-4fda-adad-4fc0a0bde213 req-b46753b5-d44b-47ca-acf6-06857f2d67f5 service nova] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:41.171757 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bcb5f561-8030-4fda-adad-4fc0a0bde213 req-b46753b5-d44b-47ca-acf6-06857f2d67f5 service nova] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:41.172043 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bcb5f561-8030-4fda-adad-4fc0a0bde213 req-b46753b5-d44b-47ca-acf6-06857f2d67f5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Processing event network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:41.206299 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:41.209075 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:41.213115 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.213293 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.213576 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.213816 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.214037 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.214250 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:41.316133 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.318101 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.320894 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.327445 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:41.349083 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.446680 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:41.472473 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updated VIF entry in instance network info cache for port b6ede3d6-5700-4ccb-9857-9c232d40ad3c. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:41.472791 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updating instance_info_cache with network_info: [{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:41.699585 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:41.708253 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:41.716506 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:41.716506 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:33:41.716881 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:41.718856 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Claim successful on node np0000004562 Jul 05 03:33:41.720553 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] VM Paused (Lifecycle Event) Jul 05 03:33:41.721735 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Took 7.24 seconds to spawn the instance on the hypervisor. Jul 05 03:33:41.724732 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:41.974576 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-14d2fb6c-4905-4799-b3a5-e89ef72278ef req-89181911-eb1d-4a8a-a223-9b9ecfe0caa5 service nova] Releasing lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:42.224225 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:42.234279 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Took 13.23 seconds to build instance. Jul 05 03:33:42.235481 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:42.237027 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] VM Resumed (Lifecycle Event) Jul 05 03:33:42.345319 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-fef4185a-f569-4011-bb88-25e9b6d4f7e4 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.516s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:42.460466 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:42.460751 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:42.461013 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No VIF found with MAC fa:16:3e:ae:92:10, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:42.461410 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Using config drive Jul 05 03:33:42.741961 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:42.744203 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.750s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:42.746007 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:42.861449 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Received event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:42.862093 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing instance network info cache due to event network-changed-f2e20c4f-b8a4-42a7-aca4-1495201a8879. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:42.862235 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] Acquiring lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:42.862322 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] Acquired lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:42.862438 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Refreshing network info cache for port f2e20c4f-b8a4-42a7-aca4-1495201a8879 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:42.942489 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Rescuing Jul 05 03:33:42.942617 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:42.942664 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:42.944129 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:42.967278 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:43.132099 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Creating config drive at /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.config Jul 05 03:33:43.137033 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsbm2zsqz {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:43.189936 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsbm2zsqz" returned: 0 in 0.053s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:43.256164 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Received event network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:43.256164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:43.256164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:43.256164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:43.256480 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] No waiting events found dispatching network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:43.256480 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-f7aaa1c4-6a43-45c1-b86e-1ad741f75c01 req-6e034250-8ae5-4c9b-9c75-a56b1a4073ee service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Received unexpected event network-vif-plugged-b6ede3d6-5700-4ccb-9857-9c232d40ad3c for instance with vm_state building and task_state spawning. Jul 05 03:33:43.274379 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "4d856996-148c-4732-9428-4f5611315969" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:43.274851 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:43.275102 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:43.275288 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:43.275463 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:43.278237 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Terminating instance Jul 05 03:33:43.370991 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:43.446571 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:43.500879 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:43.501087 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:43.700953 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:43.705817 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:43.768430 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:43.781424 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:33:43.787471 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:43.799562 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:43.847686 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:43.940129 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updated VIF entry in instance network info cache for port f2e20c4f-b8a4-42a7-aca4-1495201a8879. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:43.940427 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] [instance: cc621bcb-52cf-4d0c-9df2-36b453b50c50] Updating instance_info_cache with network_info: [{"id": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "address": "fa:16:3e:a0:5c:94", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e20c4f-b8", "ovs_interfaceid": "f2e20c4f-b8a4-42a7-aca4-1495201a8879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:43.999689 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:44.003692 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:44.105150 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999564792000001 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:44.110835 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Instance destroyed successfully. Jul 05 03:33:44.111374 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 4d856996-148c-4732-9428-4f5611315969 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:44.234643 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:44.235899 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:44.442651 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-018b140d-35e6-4063-90a4-678ebdf05cd5 req-82b8b30b-c1da-4388-8911-a816fd7b5195 service nova] Releasing lock "refresh_cache-cc621bcb-52cf-4d0c-9df2-36b453b50c50" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:44.492694 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:44.493230 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:44.493420 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] VM Started (Lifecycle Event) Jul 05 03:33:44.495771 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:44.497213 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Instance spawned successfully. Jul 05 03:33:44.497502 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:44.501514 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:44.511116 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.811s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:44.511359 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:44.613790 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704808838',display_name='tempest-ServerRescueNegativeTestJSON-server-1704808838',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-1704808838',id=10,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:30:52Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-m0bw230r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:30:52Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=4d856996-148c-4732-9428-4f5611315969,vcpu_model=,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:33:44.613978 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "address": "fa:16:3e:0a:c8:e6", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e11d0a2-91", "ovs_interfaceid": "3e11d0a2-91a5-499e-8187-36d21e002ab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:44.614697 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:44.614972 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:33:44.646025 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.646025 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.646357 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e11d0a2-91, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:44.658999 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:44.674248 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.676603 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.676952 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25742128-8fe8-419e-a419-87faa61d9be1) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:44.679414 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:44.681594 np0000004562 nova-compute[99148]: INFO os_vif [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c8:e6,bridge_name='br-int',has_traffic_filtering=True,id=3e11d0a2-91a5-499e-8187-36d21e002ab8,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e11d0a2-91') Jul 05 03:33:44.682051 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Deleting instance files /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969_del Jul 05 03:33:44.683818 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Deletion of /opt/stack/data/nova/instances/4d856996-148c-4732-9428-4f5611315969_del complete Jul 05 03:33:44.740330 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:33:44.817704 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.818904 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:44.946921 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:44.947137 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing instance network info cache due to event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:44.947685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:44.947926 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:44.948245 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing network info cache for port e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:44.996137 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:44.998196 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:45.004234 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.004391 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.004777 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.005029 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.005299 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.005569 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:45.017662 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:45.017662 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:45.017662 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:45.017875 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:45.145265 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22e68e5e563a408eb03f2e43611e6001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd175025b2474c2997358e1e58b5aba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:45.188805 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Took 1.41 seconds to destroy the instance on the hypervisor. Jul 05 03:33:45.189298 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:33:45.189616 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:33:45.189746 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 4d856996-148c-4732-9428-4f5611315969] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:33:45.189971 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:45.257875 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:45.303304 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:45.303478 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:45.307086 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:33:45.307202 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Claim successful on node np0000004562 Jul 05 03:33:45.450409 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:45.501767 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:33:45.501992 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:45.502096 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] VM Paused (Lifecycle Event) Jul 05 03:33:45.512917 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Took 6.47 seconds to spawn the instance on the hypervisor. Jul 05 03:33:45.519585 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:45.521936 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:45.611215 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ffa9e69a-59e1-4472-873d-52e68622eaab req-e3b2bf2d-f643-4bd8-ad67-bdf1482a35c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-deleted-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:45.612357 np0000004562 nova-compute[99148]: INFO nova.compute.manager [req-ffa9e69a-59e1-4472-873d-52e68622eaab req-e3b2bf2d-f643-4bd8-ad67-bdf1482a35c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Neutron deleted interface 3e11d0a2-91a5-499e-8187-36d21e002ab8; detaching it from the instance and deleting it from the info cache Jul 05 03:33:45.617365 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-ffa9e69a-59e1-4472-873d-52e68622eaab req-e3b2bf2d-f643-4bd8-ad67-bdf1482a35c5 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Detach interface failed, port_id=3e11d0a2-91a5-499e-8187-36d21e002ab8, reason: Instance 4d856996-148c-4732-9428-4f5611315969 could not be found. {{(pid=99148) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 05 03:33:45.821369 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Successfully created port: 6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:45.848488 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:46.004630 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:46.007579 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updated VIF entry in instance network info cache for port e425a405-5f9f-4291-953d-7cc71b8e3c7a. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:46.007911 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:46.008931 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:46.009092 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] VM Resumed (Lifecycle Event) Jul 05 03:33:46.022841 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:46.051691 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Took 12.30 seconds to build instance. Jul 05 03:33:46.059055 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:46.118792 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:46.130138 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:46.385823 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Successfully updated port: 6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:46.437647 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance destroyed successfully. Jul 05 03:33:46.438161 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:46.450755 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:46.510653 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:46.510903 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:46.511110 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:46.511296 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:46.511559 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:46.511776 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] No waiting events found dispatching network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:46.511918 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-a8ae9b01-2871-4cce-a272-5cca848b2c53 req-fdd6fa18-c959-484b-ae8b-050bc75d5a4e service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:33:46.512954 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:46.515343 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:46.526825 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Booting with volume 913e3063-8613-4376-a738-f5cdd559ef16 at /dev/vda Jul 05 03:33:46.555498 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-49320a46-a07e-4c1a-8e45-619caae873cc tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.812s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:46.561689 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 4d856996-148c-4732-9428-4f5611315969] Took 1.37 seconds to deallocate network for instance. Jul 05 03:33:46.586682 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:46.599159 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:33:46.627613 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:46.671037 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:46.671491 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:33:46.677214 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:33:46.677214 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:33:46.686822 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:33:46.688360 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fea3:af99', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3'] Jul 05 03:33:46.688501 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:33:46.688608 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:33:46.688895 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:46.689093 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Updating existing volume attachment record: 8b36fe78-0a2e-46b9-b4a3-46a390751ccb {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:33:46.889585 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:46.890056 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquired lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:46.890056 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:46.901632 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004247239999131125 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:46.902166 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:46.902308 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:46.902422 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.202227579999999 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:46.902502 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.202139336000073 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:46.902912 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] VM Stopped (Lifecycle Event) Jul 05 03:33:46.942895 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attempting a stable device rescue Jul 05 03:33:47.018460 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.99975158899997 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:47.027760 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received event network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:47.029044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] Acquiring lock "4d856996-148c-4732-9428-4f5611315969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:47.029270 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:47.029457 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] Lock "4d856996-148c-4732-9428-4f5611315969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:47.029612 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] No waiting events found dispatching network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:47.029804 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-507e20c1-2202-4a15-84f2-ffec381d6f7b req-5a986d54-afd0-458a-a78c-357a4fdd92c6 service nova] [instance: 4d856996-148c-4732-9428-4f5611315969] Received unexpected event network-vif-unplugged-3e11d0a2-91a5-499e-8187-36d21e002ab8 for instance with vm_state deleted and task_state None. Jul 05 03:33:47.072343 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=99148) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 05 03:33:47.075262 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:47.081269 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:33:47.081442 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Creating image(s) Jul 05 03:33:47.082400 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:47.082551 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:47.083129 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:47.083320 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:47.147083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:47.147310 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:47.406724 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7e617f3b-9f07-4a5a-b7e4-2d7fd45d3585] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:47.450550 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:47.583902 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:47.585879 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:47.586377 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:47.586880 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:47.651762 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:47.684950 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-changed-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:47.685518 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Refreshing instance network info cache due to event network-changed-6db45305-69e2-4a86-9594-233c22e8d1da. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:47.685810 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] Acquiring lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:47.768598 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Updating instance_info_cache with network_info: [{"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:48.156643 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.853s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:48.162424 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.087s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:48.162628 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:33:48.271502 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Releasing lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:48.271810 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Instance network_info: |[{"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:48.273550 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] Acquired lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:48.273550 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Refreshing network info cache for port 6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:48.554330 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.558935 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.559396 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:48.643991 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.part --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:48.644609 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] 89d357db-3aaf-4e9d-b387-8984a527e015 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:33:48.645490 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:33:48.645897 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.part /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:48.677685 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:33:48.678367 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:33:48.679006 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:48.679464 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:48.777742 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:48.791675 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13eaeef1f2334d698ac49202f06873c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef60743c71546fc87af8540e17c0506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:33:48.818124 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:48.819158 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:48.819395 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Creating image(s) Jul 05 03:33:48.819682 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:33:48.819835 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Ensure instance console log exists: /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:48.820082 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:48.820267 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:48.820393 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:48.820981 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Start _get_guest_xml network_info=[{"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8b36fe78-0a2e-46b9-b4a3-46a390751ccb', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '907b450e-ab2f-4826-bc7d-f25bcbedaba2', 'attached_at': '', 'detached_at': '', 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'serial': '913e3063-8613-4376-a738-f5cdd559ef16'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:48.827478 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:48.828749 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='907b450e-ab2f-4826-bc7d-f25bcbedaba2'), owner=OwnerMeta(userid='22e68e5e563a408eb03f2e43611e6001', username='tempest-ImageDependencyTests-784476616-project-member', projectid='bd175025b2474c2997358e1e58b5aba1', projectname='tempest-ImageDependencyTests-784476616'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222428.8283617) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:48.833435 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:48.833601 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:48.834648 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:48.834847 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:48.835802 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:48.836194 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:48.836326 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:48.836432 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:48.836549 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:48.836643 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:48.836745 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:48.836897 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:48.836991 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:48.837103 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:48.837196 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:48.837306 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:48.848992 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.part /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.converted" returned: 0 in 0.203s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:48.853418 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:33:48.853749 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:48.853888 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:48.854236 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:48.854402 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:48.865959 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:48.897164 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:48.900788 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:48.900788 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:48.900788 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:48.901198 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:48.901356 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:48.920384 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:48.920384 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:48.926511 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:48.926511 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16] added Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:48.932421 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:48.932805 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:48.932805 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:48.932916 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16] added Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:48.939016 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:48.939334 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:48.939334 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:48.939418 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:48.961962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:48.962876 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.376s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:48.963460 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.975476 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.976706 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:48.977829 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:48.978253 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.987298 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:48.987650 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:49.076872 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:49.077837 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd,backing_fmt=raw /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.rescue {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:49.102940 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:49.103311 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:49.130377 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2e8952a4fb92269892d6ad05c335ee7345742cd,backing_fmt=raw /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.rescue" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:49.130377 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "f2e8952a4fb92269892d6ad05c335ee7345742cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.152s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:49.130377 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'migration_context' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:49.133902 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Received event network-changed-b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:49.134090 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Refreshing instance network info cache due to event network-changed-b6ede3d6-5700-4ccb-9857-9c232d40ad3c. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:49.134241 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] Acquiring lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:49.134368 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] Acquired lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:49.134541 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Refreshing network info cache for port b6ede3d6-5700-4ccb-9857-9c232d40ad3c {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:49.181581 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:33:49.269952 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:49.323241 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Successfully created port: 8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:33:49.464428 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Updated VIF entry in instance network info cache for port 6db45305-69e2-4a86-9594-233c22e8d1da. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:49.464690 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Updating instance_info_cache with network_info: [{"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:49.608584 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:49.642234 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:49.644240 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:49.644644 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:49.646941 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Start _get_guest_xml network_info=[{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "vif_mac": "fa:16:3e:b8:52:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue={'image_id': '89d357db-3aaf-4e9d-b387-8984a527e015', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '62f066ea-90b6-4468-8a14-21ff4e88f21b', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '4a23ad30-ca25-4cdd-bc41-596617129de7', 'attached_at': '', 'detached_at': '', 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'serial': '089a0fef-69ed-4d40-82af-e702bd977251'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:49.647701 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'resources' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:49.665686 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:49.665986 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:33:49.678914 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:49.688908 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:33:49.852517 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Successfully updated port: 8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:33:49.913204 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Received event network-changed-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:49.914486 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Refreshing instance network info cache due to event network-changed-8cdf803e-caa2-4952-b492-98cab506b374. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:33:49.914674 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] Acquiring lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:49.914817 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] Acquired lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:49.915087 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Refreshing network info cache for port 8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:33:49.933925 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:49.942889 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:49.947811 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:49.958808 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:49.964642 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:49.967430 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e32740ca-baf4-4425-8716-caeccbc729c6 req-d1c46a9e-d644-4815-a60d-6f12e4a8b30c service nova] Releasing lock "refresh_cache-907b450e-ab2f-4826-bc7d-f25bcbedaba2" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:49.975112 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:49.981925 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.981925 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.981925 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.981925 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.981925 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:49.982573 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.982573 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.982573 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.982573 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.982573 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:49.989045 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.989045 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.989045 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.989045 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.989045 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:49.989283 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.989283 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:49.989283 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.989283 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:49.989283 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:50.016873 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.40.100,3260] Jul 05 03:33:50.016873 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.40.100,3260] successful. Jul 05 03:33:50.016873 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:50.028041 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:50.034659 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.50.100,3260] Jul 05 03:33:50.034659 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.50.100,3260] successful. Jul 05 03:33:50.034659 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.042892 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.043104 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:50.043336 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:50.043445 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:50.044201 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] HCTL ('7', '-', '-', 0) found on session 41 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:50.044319 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:50.045756 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:50.048935 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:50.056488 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Searching for a device in session 41 and hctl ['7', '*', '*', 0] yield: None {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.067434 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:50.067802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:50.068082 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:50.068516 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] HCTL ('8', '-', '-', 0) found on session 42 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:50.068621 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:50.082321 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Searching for a device in session 42 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:50.082424 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:50.117738 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.954s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:50.150732 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:50.153936 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:50.155509 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-992270391', uuid='4a23ad30-ca25-4cdd-bc41-596617129de7'), owner=OwnerMeta(userid='a7fe0b14458841e59bc204d2b3feefc5', username='tempest-ServerStableDeviceRescueTest-1168613683-project-member', projectid='829f33118604409f91b100dc1a08110f', projectname='tempest-ServerStableDeviceRescueTest-1168613683'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "vif_mac": "fa:16:3e:b8:52:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222430.1550703) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:50.156507 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:50.156916 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:50.157726 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:50.157920 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:50.158952 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:50.159328 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:50.159506 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:50.159637 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:50.159828 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:50.159933 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:50.160066 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:50.160256 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:50.160383 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:50.160553 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:50.160683 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:50.160914 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:50.161045 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:50.206203 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Deleted allocations for instance 4d856996-148c-4732-9428-4f5611315969 Jul 05 03:33:50.226314 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updated VIF entry in instance network info cache for port b6ede3d6-5700-4ccb-9857-9c232d40ad3c. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:33:50.226608 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updating instance_info_cache with network_info: [{"id": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "address": "fa:16:3e:ae:92:10", "network": {"id": "752377e9-d6fa-4942-9906-f1086218e248", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1029330968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d501ff4cdb7245fba675291a98ccb926", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ede3d6-57", "ovs_interfaceid": "b6ede3d6-5700-4ccb-9857-9c232d40ad3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:50.356962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:33:50.418026 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:50.489733 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:50.655924 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:50.663182 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:50.672479 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:50.672685 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:50.673008 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:33:50.676768 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:50.704198 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:33:50.705875 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:33:50.706089 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Creating image(s) Jul 05 03:33:50.707133 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "/opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:50.707508 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:50.708294 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:50.709333 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:50.715406 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:50.728322 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:50.745685 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7f505896-564d-4156-b03c-809469a92229 req-58e4d7b7-e318-489e-954e-fc2d810dbe33 service nova] Releasing lock "refresh_cache-fcd1b284-0f6d-4a08-8d63-10328b665f2c" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:50.791371 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config --force-share --output=json" returned: 0 in 0.115s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:50.791795 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:50.791987 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:50.792501 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "/opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:50.792878 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:33:50.793244 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:50.793386 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:50.821408 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.093s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:50.821801 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:50.822174 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:50.822633 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:50.825265 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:33:50.825629 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:50.918343 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:50.918864 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:50.962883 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk 1073741824" returned: 0 in 0.044s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:50.963427 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:50.963831 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:51.044361 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:51.045376 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:33:51.045629 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:51.063434 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Searching for a device in session 41 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:51.063574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:51.141942 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:51.142247 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Cannot resize image /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:33:51.142505 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:33:51.142663 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Ensure instance console log exists: /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:33:51.142958 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:51.143129 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:51.143260 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:51.157982 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d8a372e3-b280-4879-8425-2d3f78f10dc9 req-7adce926-4089-424e-8be5-b146c9d58385 service nova] Releasing lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:51.158265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:33:51.158411 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:33:51.229063 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-cd50ea47-d17d-4a30-bf26-33e7c314a5e3 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "4d856996-148c-4732-9428-4f5611315969" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.954s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:51.449269 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:51.606938 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:51.609000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:51.609000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:51.609000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:51.609000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:51.611133 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Terminating instance Jul 05 03:33:51.672165 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:51.672447 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:51.672773 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:51.675333 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:51.675379 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=99148) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 05 03:33:51.675630 np0000004562 nova-compute[99148]: DEBUG oslo_service.periodic_task [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running periodic task ComputeManager.update_available_resource {{(pid=99148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:51.730088 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:33:51.885517 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:51.916929 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Found WWN 330000000bb919cb0 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:33:51.917365 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.063s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:51.917802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] <== connect_volume: return (3064ms) {'type': 'block', 'scsi_wwn': '330000000bb919cb0', 'path': '/dev/dm-0', 'multipath_id': '330000000bb919cb0'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:51.918084 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb919cb0', 'path': '/dev/dm-0', 'multipath_id': '330000000bb919cb0'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:33:51.918734 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.125s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:51.918944 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:51.936100 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:51.936259 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:51.936905 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:51.937156 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:51.937777 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:51.938058 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:51.953574 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:33:51.958690 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:51.971010 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:51.978583 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.991006 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.991323 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:51.991496 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:51.991577 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:51.992060 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] HCTL ('12', '0', '0', 0) found on session 40 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:51.992166 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.994473 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:33:51.994695 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:51.994907 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:51.995043 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:51.995627 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] HCTL ('11', '0', '0', 0) found on session 39 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:51.995769 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:52.003457 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching for a device in session 40 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:52.003675 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:52.005804 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Searching for a device in session 39 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:52.005989 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:52.029417 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Updating instance_info_cache with network_info: [{"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:52.114325 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:33:52.119106 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.128137 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.180202 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:52.180409 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:52.180577 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:52.180739 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Auditing locally available compute resources for np0000004562 (node: np0000004562) {{(pid=99148) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 05 03:33:52.421509 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999627065999903 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:52.424022 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='instance-depend-image',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd175025b2474c2997358e1e58b5aba1',ramdisk_id='',reservation_id='r-7skamgdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-784476616',owner_user_name='tempest-ImageDependencyTests-784476616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:46Z,user_data=None,user_id='22e68e5e563a408eb03f2e43611e6001',uuid=907b450e-ab2f-4826-bc7d-f25bcbedaba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:52.424192 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converting VIF {"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:52.424811 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:52.425842 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lazy-loading 'pci_devices' on Instance uuid 907b450e-ab2f-4826-bc7d-f25bcbedaba2 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:52.426769 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Instance destroyed successfully. Jul 05 03:33:52.428879 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lazy-loading 'resources' on Instance uuid 79dcf4df-1d4d-462e-9b02-4bf431533787 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:52.531214 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:33:52.531469 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Instance network_info: |[{"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:33:52.534072 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Start _get_guest_xml network_info=[{"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:33:52.538706 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:52.540364 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='919896f9-4a75-4a05-a0ba-587676c48b0a'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222432.5399036) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:33:52.541502 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:33:52.542005 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:33:52.544058 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:33:52.544058 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:33:52.544204 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:33:52.544547 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:33:52.544752 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:33:52.545150 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:33:52.545150 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:33:52.545150 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:33:52.545261 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:33:52.546797 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:33:52.546797 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:33:52.546797 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:33:52.546797 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:33:52.546797 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:33:52.555443 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-1',id=28,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-ys0dp15f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=919896f9-4a75-4a05-a0ba-587676c48b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:52.555687 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:52.556202 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=8cdf803e-caa2-4952-b492-98cab506b374,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf803e-ca') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:52.556623 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'pci_devices' on Instance uuid 919896f9-4a75-4a05-a0ba-587676c48b0a {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:52.930988 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449495268',display_name='tempest-ServerRescueNegativeTestJSON-server-449495268',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverrescuenegativetestjson-server-449495268',id=9,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:31:07Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e31f3215e6204f19859b8f62235b8cb7',ramdisk_id='',reservation_id='r-kay3kuuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-447473610',owner_user_name='tempest-ServerRescueNegativeTestJSON-447473610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:31:13Z,user_data=None,user_id='76127ae0b2ae45ff8d4cd7430fc67ec7',uuid=79dcf4df-1d4d-462e-9b02-4bf431533787,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] End _get_guest_xml xml= Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 907b450e-ab2f-4826-bc7d-f25bcbedaba2 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: instance-0000001b Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: instance-depend-image Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 2026-07-05 03:33:48 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: True Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: tempest-ImageDependencyTests-784476616-project-member Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: tempest-ImageDependencyTests-784476616 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 907b450e-ab2f-4826-bc7d-f25bcbedaba2 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 907b450e-ab2f-4826-bc7d-f25bcbedaba2 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: 913e3063-8613-4376-a738-f5cdd559ef16 Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: Jul 05 03:33:52.931476 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Preparing to wait for external event network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='instance-depend-image',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd175025b2474c2997358e1e58b5aba1',ramdisk_id='',reservation_id='r-7skamgdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-784476616',owner_user_name='tempest-ImageDependencyTests-784476616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:46Z,user_data=None,user_id='22e68e5e563a408eb03f2e43611e6001',uuid=907b450e-ab2f-4826-bc7d-f25bcbedaba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converting VIF {"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:52.934694 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.936220 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.936220 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converting VIF {"id": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "address": "fa:16:3e:f9:d2:46", "network": {"id": "c5222b6d-97b9-4643-b894-c5023118942c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1630112082-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e31f3215e6204f19859b8f62235b8cb7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap599d3a0a-ad", "ovs_interfaceid": "599d3a0a-adce-4481-91ed-7f7c3ddfdb00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:52.936220 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:52.936220 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:52.936220 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:33:52.936892 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.937094 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '705a640e-792c-528e-855b-c35ed5ba6f36', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.938845 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.939458 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:52.939647 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.943016 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.943152 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6db45305-69, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.943445 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6db45305-69, col_values=(('qos', UUID('94d4c2b3-6323-4e29-a081-4f2f5d2cc620')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.943612 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6db45305-69, col_values=(('external_ids', {'iface-id': '6db45305-69e2-4a86-9594-233c22e8d1da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:6f:58', 'vm-uuid': '907b450e-ab2f-4826-bc7d-f25bcbedaba2'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.944357 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.947791 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:52.951727 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:33:52.954477 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.961962 np0000004562 nova-compute[99148]: INFO os_vif [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') Jul 05 03:33:52.969637 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.980531 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.987562 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.987562 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap599d3a0a-ad, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:52.990932 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:52.990932 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] End _get_guest_xml xml= Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 919896f9-4a75-4a05-a0ba-587676c48b0a Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: instance-0000001c Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: multiattach-server-1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 2026-07-05 03:33:52 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: True Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: bare Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 919896f9-4a75-4a05-a0ba-587676c48b0a Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 919896f9-4a75-4a05-a0ba-587676c48b0a Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: Jul 05 03:33:53.059243 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:53.061198 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Preparing to wait for external event network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:33:53.061198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:53.061198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:53.061198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:53.061198 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-1',id=28,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-ys0dp15f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=919896f9-4a75-4a05-a0ba-587676c48b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:33:53.063216 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:53.064084 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=8cdf803e-caa2-4952-b492-98cab506b374,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf803e-ca') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:53.064511 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=8cdf803e-caa2-4952-b492-98cab506b374,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf803e-ca') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:33:53.092321 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2726a0d-0eec-4e92-8ebc-b6ddfe671331) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.095915 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:53.099737 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.099737 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.099737 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b5187d5-e140-5bce-af76-621214f7e05b', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.102086 np0000004562 nova-compute[99148]: INFO os_vif [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:46,bridge_name='br-int',has_traffic_filtering=True,id=599d3a0a-adce-4481-91ed-7f7c3ddfdb00,network=Network(c5222b6d-97b9-4643-b894-c5023118942c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap599d3a0a-ad') Jul 05 03:33:53.102086 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:53.102086 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.107184 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Deleting instance files /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787_del Jul 05 03:33:53.113982 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.114569 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cdf803e-ca, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.115104 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cdf803e-ca, col_values=(('qos', UUID('75822259-b560-4d3e-9e5c-c12675cf9e4f')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.115840 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Deletion of /opt/stack/data/nova/instances/79dcf4df-1d4d-462e-9b02-4bf431533787_del complete Jul 05 03:33:53.117645 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cdf803e-ca, col_values=(('external_ids', {'iface-id': '8cdf803e-caa2-4952-b492-98cab506b374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:cf:76', 'vm-uuid': '919896f9-4a75-4a05-a0ba-587676c48b0a'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:33:53.119996 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.122108 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:33:53.128055 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.146401 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.164020 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:53.164665 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:53.165778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:53.165973 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:53.166739 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] No waiting events found dispatching network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:53.166739 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-7b09c3bb-f709-46c0-a08f-b8eb2f433202 req-e1a9dffa-eb6c-4eca-a130-a4b2e0c3f044 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:33:53.180384 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.192725 np0000004562 nova-compute[99148]: INFO os_vif [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=8cdf803e-caa2-4952-b492-98cab506b374,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf803e-ca') Jul 05 03:33:53.193434 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.201540 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.354136 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4dcd66dc-3630-4f67-bb67-fca45e234250 req-9b56e2c1-91f9-4991-b4fa-e22bf50a6d04 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:53.354766 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4dcd66dc-3630-4f67-bb67-fca45e234250 req-9b56e2c1-91f9-4991-b4fa-e22bf50a6d04 service nova] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:53.354992 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4dcd66dc-3630-4f67-bb67-fca45e234250 req-9b56e2c1-91f9-4991-b4fa-e22bf50a6d04 service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:53.355207 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-4dcd66dc-3630-4f67-bb67-fca45e234250 req-9b56e2c1-91f9-4991-b4fa-e22bf50a6d04 service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:53.355855 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-4dcd66dc-3630-4f67-bb67-fca45e234250 req-9b56e2c1-91f9-4991-b4fa-e22bf50a6d04 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Processing event network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:53.369665 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.372477 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.404735 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.458646 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.504165 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.534337 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.573764 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:53.574743 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.630341 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Took 1.52 seconds to destroy the instance on the hypervisor. Jul 05 03:33:53.631330 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:33:53.631689 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:33:53.631918 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:33:53.632244 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:53.679755 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc621bcb-52cf-4d0c-9df2-36b453b50c50/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:53.682345 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.745838 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.747011 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:53.762531 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:53.771302 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:53.771778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.857088 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:53.859866 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '79dcf4df-1d4d-462e-9b02-4bf431533787' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '79dcf4df-1d4d-462e-9b02-4bf431533787' (instance-00000009) Jul 05 03:33:53.861890 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.948434 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:53.948987 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:53.975539 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Found WWN 3300000001935b047 for multipath device dm-4 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:33:53.976472 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.058s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:53.976790 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] <== connect_volume: return (3182ms) {'type': 'block', 'scsi_wwn': '3300000001935b047', 'path': '/dev/dm-4', 'multipath_id': '3300000001935b047'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:53.977044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001935b047', 'path': '/dev/dm-4', 'multipath_id': '3300000001935b047'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:33:54.039449 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd1b284-0f6d-4a08-8d63-10328b665f2c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.042085 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.122044 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.122720 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.209071 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134dd22e-099b-4049-b8c3-8bbd75028bdf/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.212956 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:33:54.215826 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.306709 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.307305 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.391873 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e1371d-6866-4ebb-a546-610aadd4e70e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.395280 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.486881 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.489932 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.491496 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-992270391',display_name='tempest-ServerStableDeviceRescueTest-server-992270391',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-serverstabledevicerescuetest-server-992270391',id=20,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3cgpE1/whp8iCib/po0WOIrscQYIZo+CDlMaxzb0kY30M22S/ySFaRtjU2WKp7g7gbtxDdY68zz6czGutiDzU/CxfQ6LPCstnmSm3DUE6ZHSqfVsF+jAKVmuKaK1r4Pg==',key_name='tempest-keypair-859204523',keypairs=,launch_index=0,launched_at=2026-07-05T03:32:43Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='829f33118604409f91b100dc1a08110f',ramdisk_id='',reservation_id='r-yynt2vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1168613683',owner_user_name='tempest-ServerStableDeviceRescueTest-1168613683-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7fe0b14458841e59bc204d2b3feefc5',uuid=4a23ad30-ca25-4cdd-bc41-596617129de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "vif_mac": "fa:16:3e:b8:52:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:33:54.491887 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converting VIF {"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "vif_mac": "fa:16:3e:b8:52:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:33:54.493120 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:52:56,bridge_name='br-int',has_traffic_filtering=True,id=710c3a58-0bbc-436c-aebe-a5694d9449fa,network=Network(e0a356c5-90fd-4802-a58d-99145217c69d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710c3a58-0b') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:33:54.494641 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:54.496146 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:54.496263 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:54.496388 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] No VIF found with MAC fa:16:3e:9a:6f:58, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:54.496847 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Using config drive Jul 05 03:33:54.518164 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:33:54.578625 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.579039 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:33:54.582119 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.664336 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.664902 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.719825 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:54.719966 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:54.720046 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:3e:cf:76, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:54.720616 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Using config drive Jul 05 03:33:54.744564 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.746968 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.834345 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.834986 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.927822 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e756d2-be55-4c56-9c4c-0cba5eedc592/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.934096 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:33:54.935169 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:54.977487 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:54.977887 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Hypervisor/Node resource view: name=np0000004562 free_ram=49657MB free_disk=73.9607162475586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=99148) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 05 03:33:54.978070 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:54.978325 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:55.000235 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] End _get_guest_xml xml= Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: instance-00000014 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 196608 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-server-992270391 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 2026-07-05 03:33:50 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 192 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: True Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: bare Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 0 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: ide Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: pc Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: virtio Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-1168613683-project-member Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: tempest-ServerStableDeviceRescueTest-1168613683 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 4a23ad30-ca25-4cdd-bc41-596617129de7 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: hvm Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 128 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 1 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: 089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: Jul 05 03:33:55.001625 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:33:55.005856 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance destroyed successfully. Jul 05 03:33:55.016951 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:55.022505 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Took 1.39 seconds to deallocate network for instance. Jul 05 03:33:55.140545 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Creating config drive at /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2/disk.config Jul 05 03:33:55.146173 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpstv69jmx {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:55.208342 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpstv69jmx" returned: 0 in 0.062s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:55.234032 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:55.253744 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:55.253980 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Acquiring lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:55.254165 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:55.254374 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:55.254454 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] No waiting events found dispatching network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:55.254685 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received unexpected event network-vif-unplugged-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 for instance with vm_state deleted and task_state None. Jul 05 03:33:55.256136 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Received event network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:55.256299 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:55.256417 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:55.256562 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:55.256736 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Processing event network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:33:55.256806 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Received event network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:55.256909 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:55.257034 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:55.257121 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:55.257233 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] No waiting events found dispatching network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:55.257334 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-78a9a23e-7d41-44ff-85ee-d9d24bccc54d req-caff38db-07ca-4016-813c-5a8f50cdd207 service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Received unexpected event network-vif-plugged-8cdf803e-caa2-4952-b492-98cab506b374 for instance with vm_state building and task_state spawning. Jul 05 03:33:55.379380 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Creating config drive at /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.config Jul 05 03:33:55.384069 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt9r_shzz {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:55.424092 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:55.424724 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:55.424822 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:55.424948 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:55.425074 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] No waiting events found dispatching network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:33:55.425178 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received unexpected event network-vif-plugged-6db45305-69e2-4a86-9594-233c22e8d1da for instance with vm_state building and task_state spawning. Jul 05 03:33:55.425312 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-33a46eb7-8534-4bc9-82f4-7251a1643093 req-6efbf7f4-6c90-4fc4-bbc3-c43237bde6ad service nova] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Received event network-vif-deleted-599d3a0a-adce-4481-91ed-7f7c3ddfdb00 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:33:55.444133 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/919896f9-4a75-4a05-a0ba-587676c48b0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt9r_shzz" returned: 0 in 0.060s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:55.539721 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:33:56.059218 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 79dcf4df-1d4d-462e-9b02-4bf431533787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.059426 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 5e2ef932-ebb3-4532-aa04-0c0a7602812a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.059580 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 134dd22e-099b-4049-b8c3-8bbd75028bdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.059692 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 25e1371d-6866-4ebb-a546-610aadd4e70e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.059824 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 4a23ad30-ca25-4cdd-bc41-596617129de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.059924 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance cc621bcb-52cf-4d0c-9df2-36b453b50c50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060016 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 7d3677fa-c41c-4c87-8991-c3d456184155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060112 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060200 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 22ef7527-b9d6-4fde-aefc-20c4e4a0271b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060296 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance fcd1b284-0f6d-4a08-8d63-10328b665f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060389 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 907b450e-ab2f-4826-bc7d-f25bcbedaba2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060480 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Instance 919896f9-4a75-4a05-a0ba-587676c48b0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=99148) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 05 03:33:56.060704 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 05 03:33:56.060862 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Final resource view: name=np0000004562 phys_ram=64301MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:33:54 up 30 min, 2 users, load average: 8.07, 5.81, 2.89\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_deleting': '1', 'num_os_type_None': '12', 'num_proj_e31f3215e6204f19859b8f62235b8cb7': '1', 'io_workload': '3', 'num_task_None': '8', 'num_proj_4ef60743c71546fc87af8540e17c0506': '5', 'num_proj_fe307c595da542e184ffe93fcfd11d4c': '2', 'num_task_rescuing': '1', 'num_proj_829f33118604409f91b100dc1a08110f': '1', 'num_proj_46eb0f51c1c14cd59248f83bc46d358a': '1', 'num_proj_d501ff4cdb7245fba675291a98ccb926': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_bd175025b2474c2997358e1e58b5aba1': '1'} {{(pid=99148) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 05 03:33:56.119973 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:56.128663 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:56.136493 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:56.451789 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:56.531567 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:56.531699 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:56.531880 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name vdc, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:56.531982 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:33:56.532110 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] No VIF found with MAC fa:16:3e:b8:52:56, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:33:56.532764 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Using config drive Jul 05 03:33:56.788705 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:56.789195 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:57.004936 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:57.005656 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:57.005911 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] VM Started (Lifecycle Event) Jul 05 03:33:57.006083 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:33:57.008191 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:57.008999 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:33:57.011260 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Instance spawned successfully. Jul 05 03:33:57.011588 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:57.014088 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Instance spawned successfully. Jul 05 03:33:57.014088 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:33:57.035407 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:57.292691 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:57.510797 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:57.513401 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:57.521917 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.522045 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.522288 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.522523 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.522842 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.523102 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.530690 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:33:57.539478 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:57.542256 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'keypairs' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:33:57.798827 np0000004562 nova-compute[99148]: DEBUG nova.compute.resource_tracker [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Compute_service record updated for np0000004562:np0000004562 {{(pid=99148) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 05 03:33:57.799424 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.821s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:57.799424 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.260s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:33:57.799638 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [None req-112b276c-8c7b-4196-8d63-cf3ccee15971 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.99 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:33:58.017682 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:33:58.021436 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:58.021750 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] VM Paused (Lifecycle Event) Jul 05 03:33:58.035867 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Took 7.33 seconds to spawn the instance on the hypervisor. Jul 05 03:33:58.036010 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:58.037690 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Took 9.22 seconds to spawn the instance on the hypervisor. Jul 05 03:33:58.037924 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:58.048902 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:33:58.050955 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:33:58.130276 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:58.200204 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Creating config drive at /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config.rescue Jul 05 03:33:58.208384 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptryt5i3q {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:58.264077 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a23ad30-ca25-4cdd-bc41-596617129de7/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptryt5i3q" returned: 0 in 0.055s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:58.487396 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:33:58.487614 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:33:58.524478 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:58.527271 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:58.527797 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] VM Started (Lifecycle Event) Jul 05 03:33:58.547114 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Took 13.30 seconds to build instance. Jul 05 03:33:58.556696 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Took 16.93 seconds to build instance. Jul 05 03:33:58.703160 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:58.712286 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:33:58.990786 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:33:59.031443 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:59.035898 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:33:59.049049 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.814s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:59.058112 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.442s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:59.105149 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00045616900001732574 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:59.105678 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:59.105870 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:59.106098 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] VM Stopped (Lifecycle Event) Jul 05 03:33:59.106852 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.911216050999883 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:59.106973 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.9110749179999402 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:33:59.463554 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-a6b013cf-cd4a-45bc-8674-82d04c3f0804 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:33:59.498000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.699s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:33:59.539451 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:33:59.539451 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] VM Paused (Lifecycle Event) Jul 05 03:33:59.570954 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Deleted allocations for instance 79dcf4df-1d4d-462e-9b02-4bf431533787 Jul 05 03:33:59.608924 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-de126274-ca08-4772-84d2-f40f3dab8e2b tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 4d856996-148c-4732-9428-4f5611315969] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:00.042439 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:00.047025 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:00.047364 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] VM Resumed (Lifecycle Event) Jul 05 03:34:00.228076 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:00.228076 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing instance network info cache due to event network-changed-e425a405-5f9f-4291-953d-7cc71b8e3c7a. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:00.228457 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:00.229088 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:00.229302 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Refreshing network info cache for port e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:00.292337 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Unrescuing Jul 05 03:34:00.292782 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:00.295457 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:00.295764 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:34:00.552484 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:00.552484 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:00.582770 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-32eb8295-c798-4303-b97c-c52994370df8 tempest-ServerRescueNegativeTestJSON-447473610 tempest-ServerRescueNegativeTestJSON-447473610-project-member] Lock "79dcf4df-1d4d-462e-9b02-4bf431533787" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.975s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:00.733105 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:00.800062 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:01.055070 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:01.056455 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] VM Resumed (Lifecycle Event) Jul 05 03:34:01.144341 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:01.309746 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:01.318945 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updated VIF entry in instance network info cache for port e425a405-5f9f-4291-953d-7cc71b8e3c7a. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:34:01.319328 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:01.455997 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:01.473130 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:01.473482 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing instance network info cache due to event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:01.473686 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:01.513702 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:01.557869 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:01.559249 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:01.821601 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-babee268-1390-4f9e-9852-462a82dd4453 req-7f81fded-b0c0-4b2f-bc22-258d08304688 service nova] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:02.015552 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:02.015998 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'flavor' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:02.017041 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:02.018243 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:02.020730 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000732724000044982 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:02.021595 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:02.021851 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:02.022247 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Stopped (Lifecycle Event) Jul 05 03:34:02.026862 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.394690102999903 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:02.026862 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.394440338999857 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:02.053501 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:02.053756 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:02.061829 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 4a23ad30-ca25-4cdd-bc41-596617129de7 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:34:02.062219 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:02.062478 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Resumed (Lifecycle Event) Jul 05 03:34:02.315198 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Received event network-changed-8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:02.316326 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Refreshing instance network info cache due to event network-changed-8cdf803e-caa2-4952-b492-98cab506b374. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:02.316595 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] Acquiring lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:02.316765 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] Acquired lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:02.316923 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Refreshing network info cache for port 8cdf803e-caa2-4952-b492-98cab506b374 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:02.320288 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:02.521209 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:02.528158 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:02.536614 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:02.548078 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:02.561051 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 22ef7527-b9d6-4fde-aefc-20c4e4a0271b {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:02.565214 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:02.819169 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:02.867454 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:02.867797 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Started (Lifecycle Event) Jul 05 03:34:02.869429 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 4 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:02.872624 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Instance destroyed successfully. Jul 05 03:34:02.873431 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:02.909510 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:03.069106 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updated VIF entry in instance network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:34:03.069106 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:03.130881 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:03.145085 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:03.261772 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Updated VIF entry in instance network info cache for port 8cdf803e-caa2-4952-b492-98cab506b374. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:34:03.262065 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Updating instance_info_cache with network_info: [{"id": "8cdf803e-caa2-4952-b492-98cab506b374", "address": "fa:16:3e:3e:cf:76", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf803e-ca", "ovs_interfaceid": "8cdf803e-caa2-4952-b492-98cab506b374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:03.372201 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:03.372386 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-327edda4-d97a-4304-a425-e294255b893e tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 05 03:34:03.373497 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999827730000106 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:03.375008 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Object Instance<4a23ad30-ca25-4cdd-bc41-596617129de7> lazy-loaded attributes: flavor,numa_topology {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:34:03.541435 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Received event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:03.541674 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing instance network info cache due to event network-changed-710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:03.542142 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] Acquiring lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:03.564793 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8c5253e4-5ec0-4305-89f5-05eca275c40c req-07d8c704-212a-42a9-a01e-0956a1150ab6 service nova] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:03.565094 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] Acquired lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:03.565264 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Refreshing network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:03.571921 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:03.763901 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d52632eb-f6aa-4743-8159-1533db27b972 req-dc81cff0-425f-4f94-91fe-b95ba14fecbf service nova] Releasing lock "refresh_cache-919896f9-4a75-4a05-a0ba-587676c48b0a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:03.796106 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:03.809556 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:04.067702 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:04.435415 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:04.560565 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updated VIF entry in instance network info cache for port 710c3a58-0bbc-436c-aebe-a5694d9449fa. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:34:04.560796 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Updating instance_info_cache with network_info: [{"id": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "address": "fa:16:3e:b8:52:56", "network": {"id": "e0a356c5-90fd-4802-a58d-99145217c69d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-956060883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "829f33118604409f91b100dc1a08110f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap710c3a58-0b", "ovs_interfaceid": "710c3a58-0bbc-436c-aebe-a5694d9449fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:04.627134 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Removed pending STOPPED event for 4a23ad30-ca25-4cdd-bc41-596617129de7 due to new event Resumed> {{(pid=99148) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 05 03:34:04.627134 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:04.627134 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Resumed (Lifecycle Event) Jul 05 03:34:04.630248 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-999cd34b-001d-41db-ba1f-6da0cae9a6a8 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:04.666379 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:04.666379 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:04.666379 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Attaching volume 96221486-3151-4c31-9565-944792a5ed20 to /dev/vdb Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:04.717937 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Terminating instance Jul 05 03:34:04.729331 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:04.741523 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:04.763551 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:04.802095 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:04.802488 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:04.810929 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:04.812855 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fea3:af99', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe9a:6f58', 'fe80::10fe:90ff:fed0:4f43', 'fe80::f816:3eff:fe3e:cf76'] Jul 05 03:34:04.813760 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:04.813760 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:04.813760 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:04.813760 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating existing volume attachment record: 47c5f0be-19ce-479c-902a-cd48cf452abb {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:05.063036 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f713377-037b-4729-812b-5ebd7ee65ae8 req-4a9288c4-77e4-4c99-bb23-4d50d96e4580 service nova] Releasing lock "refresh_cache-4a23ad30-ca25-4cdd-bc41-596617129de7" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:05.129040 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:05.131191 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:05.174886 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Start destroying the instance on the hypervisor. {{(pid=99148) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 05 03:34:05.181406 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:05.190456 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:05.367689 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:05.368153 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:05.368441 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:05.368987 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:05.369367 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:05.382207 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:05.382675 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:05.382908 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:05.383630 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:05.384110 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:05.384327 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:05.395598 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:05.395598 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:05.401811 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:05.401811 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20] added Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:05.408487 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:05.408771 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:05.408940 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:05.409075 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20] added Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:05.412842 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:05.413530 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:05.413530 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:05.503299 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Instance destroyed successfully. Jul 05 03:34:05.503864 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lazy-loading 'resources' on Instance uuid 907b450e-ab2f-4826-bc7d-f25bcbedaba2 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:05.635577 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:05.635577 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] VM Started (Lifecycle Event) Jul 05 03:34:06.007396 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='instance-depend-image',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-05T03:33:58Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='bd175025b2474c2997358e1e58b5aba1',ramdisk_id='',reservation_id='r-7skamgdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-784476616',owner_user_name='tempest-ImageDependencyTests-784476616-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:33:58Z,user_data=None,user_id='22e68e5e563a408eb03f2e43611e6001',uuid=907b450e-ab2f-4826-bc7d-f25bcbedaba2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:34:06.007604 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converting VIF {"id": "6db45305-69e2-4a86-9594-233c22e8d1da", "address": "fa:16:3e:9a:6f:58", "network": {"id": "a14de86b-6035-4947-9929-c4b043ef0878", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1911e8eebd7145b9bd49ab61ecf621cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db45305-69", "ovs_interfaceid": "6db45305-69e2-4a86-9594-233c22e8d1da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:06.008204 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:06.008380 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:34:06.033511 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.033746 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.047394 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.047610 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6db45305-69, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:06.051001 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.051297 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:06.057944 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.072646 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.099887 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.137438 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:06.144133 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:06.164968 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.167269 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.167413 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.169108 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94d4c2b3-6323-4e29-a081-4f2f5d2cc620) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:06.170521 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.172042 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:06.178702 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.182240 np0000004562 nova-compute[99148]: INFO os_vif [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6f:58,bridge_name='br-int',has_traffic_filtering=True,id=6db45305-69e2-4a86-9594-233c22e8d1da,network=Network(a14de86b-6035-4947-9929-c4b043ef0878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db45305-69') Jul 05 03:34:06.185666 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:06.186001 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:06.186153 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:06.271789 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:06.271789 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:06.271789 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:06.271889 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:06.272023 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] No waiting events found dispatching network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:06.272118 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c0c1f93c-0a3a-4c62-a7f2-2b9e83247b5c req-8a9852e4-2ef1-435e-ac4c-2d98a833855f service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:34:06.409488 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:06.414059 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:06.422943 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:06.429036 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.434086 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.440462 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.448619 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.449034 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.458574 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.458898 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:06.468550 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:06.489260 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20, portal: 192.168.50.100,3260] Jul 05 03:34:06.489260 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20, portal: 192.168.50.100,3260] successful. Jul 05 03:34:06.489260 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.499556 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20, portal: 192.168.40.100,3260] Jul 05 03:34:06.499556 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20, portal: 192.168.40.100,3260] successful. Jul 05 03:34:06.499556 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.500871 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.512193 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.521553 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.521853 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:06.522096 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:06.522166 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:06.523467 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('13', '-', '-', 0) found on session 43 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:06.523570 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.528627 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:06.528886 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:06.529085 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:06.529167 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:06.530429 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('14', '-', '-', 0) found on session 44 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:06.530567 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:06.538163 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 43 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:06.538163 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:06.548505 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 44 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:06.548789 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:06.647372 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999745046999806 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.385004 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:07.421496 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00036427800000637944 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.421862 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.421980 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.951338275000126 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.422099 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=10.951215276000084 future=) was cancelled while queued, skipping {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.422165 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.422445 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:07.422704 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.224377662999814 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.422974 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] VM Stopped (Lifecycle Event) Jul 05 03:34:07.424042 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.223053242999868 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:07.925662 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 79dcf4df-1d4d-462e-9b02-4bf431533787] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:08.160077 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:08.334276 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:08.334479 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] Acquiring lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:08.334667 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:08.335767 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:08.335767 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] No waiting events found dispatching network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:08.335767 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-dddbb21c-c8e0-4e00-967b-c4f341014a97 req-a5d1bab4-733a-4fa7-9e2d-75a068fb77e8 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-unplugged-6db45305-69e2-4a86-9594-233c22e8d1da for instance with task_state deleting. {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 05 03:34:08.401438 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 330000000287f3257 for multipath device dm-5 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:08.402463 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:08.402674 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:08.402901 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:08.403750 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.217s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:08.406786 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '913e3063-8613-4376-a738-f5cdd559ef16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:08.406786 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:08.409139 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 22ef7527-b9d6-4fde-aefc-20c4e4a0271b {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:08.437070 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:08.437410 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', '41')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:08.438926 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16', '42')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:08.440136 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Resulting device map defaultdict(. at 0x7249b4385b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:08.440136 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:34:08.440297 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Flush multipath device 330000000bb919cb0 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:34:08.478628 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:08.526492 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:08.577972 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:34:08.578192 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:34:08.579099 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:34:08.590355 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:34:08.590551 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:08.603654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.641188 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.40.100,3260] Jul 05 03:34:08.641188 np0000004562 nova-compute[99148]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.40.100,3260] successful. Jul 05 03:34:08.641188 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.658246 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.672723 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.717081 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.50.100,3260] Jul 05 03:34:08.717081 np0000004562 nova-compute[99148]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-913e3063-8613-4376-a738-f5cdd559ef16, portal: 192.168.50.100,3260] successful. Jul 05 03:34:08.717081 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.735367 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:08.735617 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:08.735794 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] <== disconnect_volume: return (2550ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:08.735949 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:08.736262 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Deleting instance files /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2_del Jul 05 03:34:08.736769 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Deletion of /opt/stack/data/nova/instances/907b450e-ab2f-4826-bc7d-f25bcbedaba2_del complete Jul 05 03:34:08.865928 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:08.867388 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:08.915067 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Attempting to attach volume 96221486-3151-4c31-9565-944792a5ed20 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] attach device xml: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: 96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: Jul 05 03:34:08.916638 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:09.245286 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Took 4.07 seconds to destroy the instance on the hypervisor. Jul 05 03:34:09.250759 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._common.loopingcall [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=99148) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 05 03:34:09.250759 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Deallocating network for instance {{(pid=99148) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 05 03:34:09.250759 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] deallocate_for_instance() {{(pid=99148) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 05 03:34:09.250759 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:09.335570 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:09.371211 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'flavor' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:10.113819 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:10.381486 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:10.410191 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3e714c73-e9ce-452e-ab62-dfc93741d249 req-8b21e3fd-7b05-4c46-94e4-f9fdfcbfc191 service nova] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Received event network-vif-deleted-6db45305-69e2-4a86-9594-233c22e8d1da {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:10.579768 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:10.579900 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:10.580034 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:10.580168 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:9a:87:e9, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:10.616220 np0000004562 nova-compute[99148]: INFO nova.compute.manager [-] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Took 1.37 seconds to deallocate network for instance. Jul 05 03:34:11.176788 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Took 0.55 seconds to detach 1 volumes for instance. Jul 05 03:34:11.176788 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Deleting volume: 913e3063-8613-4376-a738-f5cdd559ef16 {{(pid=99148) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3457}} Jul 05 03:34:11.177280 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:11.188234 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "4220699d-7662-4f57-8f32-edb6e021063a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:11.188487 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "4220699d-7662-4f57-8f32-edb6e021063a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:11.443797 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:11.444283 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:11.444283 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attaching volume faeb56cb-8364-4088-a86f-a42d525eda70 to /dev/vdb Jul 05 03:34:11.471996 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:11.487561 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:11.499801 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:11.522275 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:11.557293 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:11.558994 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:11.565585 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:11.567152 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fea3:af99', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76'] Jul 05 03:34:11.567297 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:11.567378 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:11.567635 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:11.568209 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updating existing volume attachment record: 624ae896-c175-48f0-b629-9def5d0aaa94 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:11.694559 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Starting instance... {{(pid=99148) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 05 03:34:11.717137 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:11.717365 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:11.874333 np0000004562 nova-compute[99148]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=99148) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 05 03:34:11.998571 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:11.999745 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:12.119211 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:12.119669 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:12.119916 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:12.120562 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:12.121032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:12.135463 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:12.136157 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:12.136659 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:12.136891 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:12.137235 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:12.137663 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:12.147742 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b26a2092-2251-4472-9c45-aefe0ab0c110 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.479s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:12.153036 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:12.153036 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:12.153551 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:12.153551 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70] added Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:12.166206 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:12.166482 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:12.167465 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:12.167465 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70] added Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:12.168324 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:12.168528 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:12.168735 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:12.168875 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:12.271297 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:12.335629 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:34:12.335911 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:34:12.508540 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 919896f9-4a75-4a05-a0ba-587676c48b0a {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:12.838356 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:34:13.169732 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:13.169732 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:13.180588 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:13.186522 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.193200 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.198686 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.208690 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.209603 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.214424 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.214700 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:13.257137 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] Jul 05 03:34:13.257137 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] successful. Jul 05 03:34:13.257137 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.264829 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] Jul 05 03:34:13.264829 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] successful. Jul 05 03:34:13.264829 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.273808 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.278668 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.291738 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:13.292338 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.292812 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:13.293063 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:13.293417 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:13.293417 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:13.295807 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] HCTL ('7', '-', '-', 0) found on session 45 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:13.296081 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:13.296497 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] HCTL ('8', '-', '-', 0) found on session 46 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:13.296635 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:13.309393 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching for a device in session 45 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:13.309393 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:13.315352 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:13.315503 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:13.345091 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.628s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:13.347028 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.074s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:13.352190 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:34:13.352376 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Claim successful on node np0000004562 Jul 05 03:34:13.420573 np0000004562 nova-compute[99148]: INFO nova.scheduler.client.report [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Deleted allocations for instance 907b450e-ab2f-4826-bc7d-f25bcbedaba2 Jul 05 03:34:13.513637 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:14.137507 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:14.429141 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-92e5e714-cc08-4465-9c93-8d3d64dbe1c5 tempest-ImageDependencyTests-784476616 tempest-ImageDependencyTests-784476616-project-member] Lock "907b450e-ab2f-4826-bc7d-f25bcbedaba2" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.761s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:14.585660 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "919896f9-4a75-4a05-a0ba-587676c48b0a" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:14.586117 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:14.586117 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Attaching volume 96221486-3151-4c31-9565-944792a5ed20 to /dev/vdb Jul 05 03:34:14.651523 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:14.664535 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:14.691841 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:14.730179 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:14.730581 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:14.740811 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:14.742650 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fea3:af99', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76'] Jul 05 03:34:14.742860 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:14.743018 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:14.743328 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:14.743616 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Updating existing volume attachment record: 2fe2db89-e826-4183-bd31-0c01d0aa5558 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:14.953322 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:34:14.953535 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:34:15.154650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Found WWN 330000000e7257fe6 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:15.154650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:15.154650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000e7257fe6', 'path': '/dev/dm-0', 'multipath_id': '330000000e7257fe6'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:15.154650 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e7257fe6', 'path': '/dev/dm-0', 'multipath_id': '330000000e7257fe6'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:15.160237 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'flavor' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:15.309090 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:15.309410 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:15.309909 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:15.310012 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:15.310247 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:15.316736 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "interface-86e756d2-be55-4c56-9c4c-0cba5eedc592-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:15.316958 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "interface-86e756d2-be55-4c56-9c4c-0cba5eedc592-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:15.317288 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'flavor' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:15.326331 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:15.327084 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:15.327650 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:15.328033 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:15.328841 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:15.329124 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:15.345587 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:15.355799 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:15.361829 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.370964 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:15.371401 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.044s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:15.371952 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:15.372115 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('13', '0', '0', 0) found on session 43 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:15.372217 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:15.380802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 43 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:15.380960 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.381736 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:15.382204 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:15.382695 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:15.382882 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('14', '0', '0', 0) found on session 44 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:15.383009 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:15.391432 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 44 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:15.391619 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:15.456841 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:34:15.667324 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attempting to attach volume faeb56cb-8364-4088-a86f-a42d525eda70 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] attach device xml: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: Jul 05 03:34:15.668860 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:15.820219 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:15.965033 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.620s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:15.965501 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Start building networks asynchronously for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 05 03:34:15.972502 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'pci_requests' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:16.180741 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:16.327408 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:16.471313 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Allocating IP information in the background. {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 05 03:34:16.475742 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:34:16.475742 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:16.475742 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:16.478116 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Object Instance<86e756d2-be55-4c56-9c4c-0cba5eedc592> lazy-loaded attributes: flavor,pci_requests {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:34:16.478116 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] allocate_for_instance() {{(pid=99148) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 05 03:34:16.478116 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:16.478116 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:16.480495 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:16.556052 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83aab0d584c54d20b5b88157844fc8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4342bd14c5411ebcb8a0835e1b48fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:34:16.558549 np0000004562 nova-compute[99148]: DEBUG nova.policy [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e352bca5045491e9822ecc25b5ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46eb0f51c1c14cd59248f83bc46d358a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99148) authorize /opt/stack/nova/nova/policy.py:192}} Jul 05 03:34:16.917871 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:16.972587 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 05 03:34:17.011286 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Successfully created port: 1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:34:17.161059 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Successfully created port: 2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 05 03:34:17.329787 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:17.329787 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:17.331167 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:17.331167 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No VIF found with MAC fa:16:3e:a3:af:99, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:17.342791 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 330000000287f3257 for multipath device dm-5 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:17.343088 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:17.343278 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:17.343452 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:17.345650 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lazy-loading 'flavor' on Instance uuid 919896f9-4a75-4a05-a0ba-587676c48b0a {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:17.476737 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Start building block device mappings for instance. {{(pid=99148) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 05 03:34:17.545428 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Successfully updated port: 1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:34:17.613222 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Received event network-changed-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:17.613480 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Refreshing instance network info cache due to event network-changed-1376184c-f5e2-42c0-8803-ae6d2d58eabb. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:17.613531 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] Acquiring lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:17.613659 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] Acquired lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:17.613796 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Refreshing network info cache for port 1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:17.641743 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Successfully updated port: 2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 05 03:34:17.689010 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-changed-2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:17.689618 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing instance network info cache due to event network-changed-2a94f80a-2f06-44fb-93fd-18b014ef2d10. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:17.689782 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] Acquiring lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:17.689873 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] Acquired lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:17.690061 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Refreshing network info cache for port 2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:17.848333 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 919896f9-4a75-4a05-a0ba-587676c48b0a] Attempting to attach volume 96221486-3151-4c31-9565-944792a5ed20 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] attach device xml: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: 96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: Jul 05 03:34:17.849433 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:18.047391 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:18.116175 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:18.144042 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:18.174240 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:34:18.191825 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:18.313193 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Updating instance_info_cache with network_info: [] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:18.473427 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:18.485045 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Start spawning the instance on the hypervisor. {{(pid=99148) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 05 03:34:18.486273 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:34:18.486572 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Creating image(s) Jul 05 03:34:18.487114 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "/opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:18.487293 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "/opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:18.487858 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "/opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:18.488475 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:18.492457 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:18.493635 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:18.573012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.079s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:18.573500 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:18.574029 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:18.574595 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:18.579021 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:18.579540 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:18.648544 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Added VIF to instance network info cache for port 2a94f80a-2f06-44fb-93fd-18b014ef2d10. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}} Jul 05 03:34:18.649060 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating instance_info_cache with network_info: [{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:18.683417 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.104s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:18.684328 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:18.731156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b,backing_fmt=raw /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk 1073741824" returned: 0 in 0.047s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:18.731645 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.158s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:18.732037 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:18.816314 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-276fa98f-13c2-4bed-9554-e92ab4fd18b1 req-d1dc99a9-3b19-4a06-8a82-7d1e4a8150fd service nova] Releasing lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:18.816920 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquired lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:18.817184 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:34:18.819372 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:18.819817 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:34:18.820156 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:18.886931 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b388aa42-cfc1-4c09-a6df-a03fad26c448 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "7d3677fa-c41c-4c87-8991-c3d456184155" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.443s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:18.907651 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:18.908137 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Cannot resize image /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:34:18.908580 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:34:18.909590 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Ensure instance console log exists: /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:34:18.909590 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:18.909903 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:18.910578 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:19.151831 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6846595f-9cb3-4a22-bbe2-6c654bcd7f46 req-62ae73e2-c625-438c-949a-3cfd4dc5c37d service nova] Releasing lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:19.152497 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquired lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:19.152650 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:34:19.397899 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Instance cache missing network info. {{(pid=99148) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 05 03:34:19.521873 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:19.522129 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:19.522129 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:19.522239 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:3e:cf:76, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:19.549772 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:19.662102 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Updating instance_info_cache with network_info: [{"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:19.716990 np0000004562 nova-compute[99148]: WARNING nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] 0dc53a67-ffc2-4316-a42f-e686faeb1b61 already exists in list: networks containing: ['0dc53a67-ffc2-4316-a42f-e686faeb1b61']. ignoring it Jul 05 03:34:19.717129 np0000004562 nova-compute[99148]: WARNING nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] 2a94f80a-2f06-44fb-93fd-18b014ef2d10 already exists in list: port_ids containing: ['2a94f80a-2f06-44fb-93fd-18b014ef2d10']. ignoring it Jul 05 03:34:19.889620 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:20.148856 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:20.163962 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Releasing lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:20.164339 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Instance network_info: |[{"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=99148) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 05 03:34:20.166038 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Start _get_guest_xml network_info=[{"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:34:20.168000 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:34:20.169213 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-218031132', uuid='4220699d-7662-4f57-8f32-edb6e021063a'), owner=OwnerMeta(userid='83aab0d584c54d20b5b88157844fc8be', username='tempest-AttachVolumeShelveTestJSON-1628552464-project-member', projectid='4a4342bd14c5411ebcb8a0835e1b48fa', projectname='tempest-AttachVolumeShelveTestJSON-1628552464'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222460.1688743) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:34:20.170117 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:34:20.170558 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:34:20.171294 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:34:20.171492 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:34:20.172345 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:34:20.172706 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:34:20.172893 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:34:20.173020 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:34:20.173154 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:34:20.173237 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:34:20.173327 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:34:20.173473 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:34:20.173657 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:34:20.173838 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:34:20.174016 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:34:20.174207 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:34:20.185382 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-218031132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachvolumeshelvetestjson-server-218031132',id=29,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8XJNujfygngCLvXkGs6GsMom4EC8JlWkZv8vgp+DOCm2oT0ba3Lu4WpnZ79lIuSacWVTHLexcgzqlyKXBghsKTmD2fcJ88Kmh8JBea8mX5ahtmlRvP6J5U/CjwF7yvfg==',key_name='tempest-keypair-1164610755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a4342bd14c5411ebcb8a0835e1b48fa',ramdisk_id='',reservation_id='r-6hkh4723',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1628552464',owner_user_name='tempest-AttachVolumeShelveTestJSON-1628552464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83aab0d584c54d20b5b88157844fc8be',uuid=4220699d-7662-4f57-8f32-edb6e021063a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:34:20.185571 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Converting VIF {"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:20.186122 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=1376184c-f5e2-42c0-8803-ae6d2d58eabb,network=Network(fffd26a2-d5f2-40f8-83ff-2669765e91f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1376184c-f5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:20.186622 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lazy-loading 'pci_devices' on Instance uuid 4220699d-7662-4f57-8f32-edb6e021063a {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:20.273732 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating instance_info_cache with network_info: [{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:20.434984 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Rebuilding instance Jul 05 03:34:20.579760 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] End _get_guest_xml xml= Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 4220699d-7662-4f57-8f32-edb6e021063a Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: instance-0000001d Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 196608 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: tempest-AttachVolumeShelveTestJSON-server-218031132 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 2026-07-05 03:34:20 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 192 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: True Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: bare Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: tempest-AttachVolumeShelveTestJSON-1628552464-project-member Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: tempest-AttachVolumeShelveTestJSON-1628552464 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 4220699d-7662-4f57-8f32-edb6e021063a Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 4220699d-7662-4f57-8f32-edb6e021063a Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: hvm Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 128 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: Jul 05 03:34:20.689667 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Preparing to wait for external event network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Acquiring lock "4220699d-7662-4f57-8f32-edb6e021063a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-05T03:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-218031132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-attachvolumeshelvetestjson-server-218031132',id=29,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8XJNujfygngCLvXkGs6GsMom4EC8JlWkZv8vgp+DOCm2oT0ba3Lu4WpnZ79lIuSacWVTHLexcgzqlyKXBghsKTmD2fcJ88Kmh8JBea8mX5ahtmlRvP6J5U/CjwF7yvfg==',key_name='tempest-keypair-1164610755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a4342bd14c5411ebcb8a0835e1b48fa',ramdisk_id='',reservation_id='r-6hkh4723',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1628552464',owner_user_name='tempest-AttachVolumeShelveTestJSON-1628552464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83aab0d584c54d20b5b88157844fc8be',uuid=4220699d-7662-4f57-8f32-edb6e021063a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Converting VIF {"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:20.692536 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=1376184c-f5e2-42c0-8803-ae6d2d58eabb,network=Network(fffd26a2-d5f2-40f8-83ff-2669765e91f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1376184c-f5') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:20.693467 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=1376184c-f5e2-42c0-8803-ae6d2d58eabb,network=Network(fffd26a2-d5f2-40f8-83ff-2669765e91f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1376184c-f5') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:34:20.693467 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.693931 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.694053 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:34:20.695617 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.695828 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76e548b2-115d-551e-badd-075b668e3aa8', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.699414 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.699414 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:20.699414 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.703106 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.703310 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1376184c-f5, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.703877 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1376184c-f5, col_values=(('qos', UUID('e4bc4471-2ac0-4d50-977a-957d2b459850')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.703877 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1376184c-f5, col_values=(('external_ids', {'iface-id': '1376184c-f5e2-42c0-8803-ae6d2d58eabb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:2e:2c', 'vm-uuid': '4220699d-7662-4f57-8f32-edb6e021063a'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.705883 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.706114 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:20.714991 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.722308 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.729025 np0000004562 nova-compute[99148]: INFO os_vif [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=1376184c-f5e2-42c0-8803-ae6d2d58eabb,network=Network(fffd26a2-d5f2-40f8-83ff-2669765e91f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1376184c-f5') Jul 05 03:34:20.754019 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.757052 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.775536 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Releasing lock "refresh_cache-86e756d2-be55-4c56-9c4c-0cba5eedc592" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:20.777792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1990495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1990495923',id=24,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJmvibn5BkLSUlJMsgt1RKvuVGfG7uZnvd4JXoCby+3TWg+md0gz1ND9h+rR2uzgIYiZIX0Rl4AR9J1f17jaT0Nt3tT83TEtSKmG3b2uTO8rhzAO0Jgb65pkV/Ln68Usg==',key_name='tempest-keypair-820072378',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:36Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46eb0f51c1c14cd59248f83bc46d358a',ramdisk_id='',reservation_id='r-91d27z59',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1679654348',owner_user_name='tempest-TaggedAttachmentsTest-1679654348-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e352bca5045491e9822ecc25b5ff38e',uuid=86e756d2-be55-4c56-9c4c-0cba5eedc592,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:34:20.778032 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converting VIF {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:20.778601 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e0:d5,bridge_name='br-int',has_traffic_filtering=True,id=2a94f80a-2f06-44fb-93fd-18b014ef2d10,network=Network(0dc53a67-ffc2-4316-a42f-e686faeb1b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a94f80a-2f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:20.779039 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e0:d5,bridge_name='br-int',has_traffic_filtering=True,id=2a94f80a-2f06-44fb-93fd-18b014ef2d10,network=Network(0dc53a67-ffc2-4316-a42f-e686faeb1b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a94f80a-2f') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:34:20.779540 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.779998 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.780220 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:34:20.781317 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.781593 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80b69bb3-6eb0-570c-8d46-fa0aa3ed3f6b', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.782676 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.783840 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:20.784191 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.786746 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.786991 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a94f80a-2f, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.787389 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a94f80a-2f, col_values=(('qos', UUID('23c3ec1d-f04e-4a4c-adf7-df7d1d64ea31')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.787593 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a94f80a-2f, col_values=(('external_ids', {'iface-id': '2a94f80a-2f06-44fb-93fd-18b014ef2d10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e0:d5', 'vm-uuid': '86e756d2-be55-4c56-9c4c-0cba5eedc592'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:20.788544 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.790125 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:20.794865 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.804155 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.808207 np0000004562 nova-compute[99148]: INFO os_vif [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e0:d5,bridge_name='br-int',has_traffic_filtering=True,id=2a94f80a-2f06-44fb-93fd-18b014ef2d10,network=Network(0dc53a67-ffc2-4316-a42f-e686faeb1b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a94f80a-2f') Jul 05 03:34:20.809060 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1990495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1990495923',id=24,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJmvibn5BkLSUlJMsgt1RKvuVGfG7uZnvd4JXoCby+3TWg+md0gz1ND9h+rR2uzgIYiZIX0Rl4AR9J1f17jaT0Nt3tT83TEtSKmG3b2uTO8rhzAO0Jgb65pkV/Ln68Usg==',key_name='tempest-keypair-820072378',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:36Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46eb0f51c1c14cd59248f83bc46d358a',ramdisk_id='',reservation_id='r-91d27z59',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1679654348',owner_user_name='tempest-TaggedAttachmentsTest-1679654348-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e352bca5045491e9822ecc25b5ff38e',uuid=86e756d2-be55-4c56-9c4c-0cba5eedc592,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:34:20.809260 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converting VIF {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:20.809831 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e0:d5,bridge_name='br-int',has_traffic_filtering=True,id=2a94f80a-2f06-44fb-93fd-18b014ef2d10,network=Network(0dc53a67-ffc2-4316-a42f-e686faeb1b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a94f80a-2f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] attach device xml: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: Jul 05 03:34:20.823239 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:20.888704 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.892755 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:20.983982 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6313790b-f775-4b0d-9938-166be1fc7326 req-143dad18-fe1a-4e31-8b89-9665fa2a6360 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Received event network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:20.988596 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6313790b-f775-4b0d-9938-166be1fc7326 req-143dad18-fe1a-4e31-8b89-9665fa2a6360 service nova] Acquiring lock "4220699d-7662-4f57-8f32-edb6e021063a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:20.988596 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6313790b-f775-4b0d-9938-166be1fc7326 req-143dad18-fe1a-4e31-8b89-9665fa2a6360 service nova] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:20.988908 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-6313790b-f775-4b0d-9938-166be1fc7326 req-143dad18-fe1a-4e31-8b89-9665fa2a6360 service nova] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:20.991580 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-6313790b-f775-4b0d-9938-166be1fc7326 req-143dad18-fe1a-4e31-8b89-9665fa2a6360 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Processing event network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 05 03:34:21.082746 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9996162f-80c1-4632-a1eb-7b8b49f82555 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "919896f9-4a75-4a05-a0ba-587676c48b0a" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.497s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:21.106540 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:21.108944 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:21.110438 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.113045 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:21.113045 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:21.113045 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] No waiting events found dispatching network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:21.113045 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-e0bf6ae3-694f-4dec-be23-7b7197eae1b1 req-17f1ff5a-4842-42c6-a15d-2ff7436101c1 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received unexpected event network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 for instance with vm_state active and task_state None. Jul 05 03:34:21.117136 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.141157 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.479004 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.563546 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.565572 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.567257 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.590927 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.599507 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.607111 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:21.647567 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044548900018526183 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:21.648073 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:21.648159 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:21.648281 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] VM Stopped (Lifecycle Event) Jul 05 03:34:21.895194 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999674816000152 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:21.895557 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999206457000128 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:21.895701 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999044665000156 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:21.896626 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance destroyed successfully. Jul 05 03:34:21.968833 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Detaching volume faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:22.017079 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attempting to driver detach volume faeb56cb-8364-4088-a86f-a42d525eda70 from mountpoint /dev/vdb Jul 05 03:34:22.021152 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Found disk vdb by alias ua-faeb56cb-8364-4088-a86f-a42d525eda70 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:22.021297 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Attempting to detach device vdb from instance 7d3677fa-c41c-4c87-8991-c3d456184155 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] detach device xml: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]:
Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: Jul 05 03:34:22.021544 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:22.026835 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Successfully detached device vdb from instance 7d3677fa-c41c-4c87-8991-c3d456184155 from the persistent domain config. Jul 05 03:34:22.027631 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:22.027933 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:22.028052 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:22.028363 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:22.028663 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:22.028811 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:22.057081 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:22.057351 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '46')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:22.057569 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '45')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:22.058352 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '46')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:22.059515 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Resulting device map defaultdict(. at 0x7249ac5f0a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'): ({'sdc'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:22.059515 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:34:22.059831 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flush multipath device 330000000e7257fe6 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:34:22.093885 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:22.140605 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:22.152335 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d03abe56-8d11-4bfd-872b-7c8679d72b7c tempest-TaggedBootDevicesTest_v242-1222577163 tempest-TaggedBootDevicesTest_v242-1222577163-project-member] [instance: 907b450e-ab2f-4826-bc7d-f25bcbedaba2] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:22.192228 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:34:22.192428 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:34:22.193863 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:34:22.204082 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:34:22.204324 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:22.218097 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.252219 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] Jul 05 03:34:22.252219 np0000004562 nova-compute[99148]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] successful. Jul 05 03:34:22.252219 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.258367 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:22.258862 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:22.258862 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] No VIF found with MAC fa:16:3e:b7:2e:2c, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:22.259138 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Using config drive Jul 05 03:34:22.271238 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.292230 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.325458 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] Jul 05 03:34:22.325458 np0000004562 nova-compute[99148]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] successful. Jul 05 03:34:22.325458 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.344396 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:22.344690 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:22.344886 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== disconnect_volume: return (317ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:22.345345 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:22.488611 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:22.489023 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:22.489023 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No VIF found with MAC fa:16:3e:7c:9e:58, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:22.764321 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:22.798319 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Stashing vm_state: active {{(pid=99148) _prep_resize /opt/stack/nova/nova/compute/manager.py:6345}} Jul 05 03:34:22.906526 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Creating config drive at /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.config Jul 05 03:34:22.912290 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmy0xqh8 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:22.975603 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4220699d-7662-4f57-8f32-edb6e021063a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmy0xqh8" returned: 0 in 0.063s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:22.995060 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1990495923', uuid='86e756d2-be55-4c56-9c4c-0cba5eedc592'), owner=OwnerMeta(userid='5e352bca5045491e9822ecc25b5ff38e', username='tempest-TaggedAttachmentsTest-1679654348-project-member', projectid='46eb0f51c1c14cd59248f83bc46d358a', projectname='tempest-TaggedAttachmentsTest-1679654348'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "address": "fa:16:3e:7c:9e:58", "network": {"id": "57b29a0c-3e81-447e-8050-23a92988186a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-387510777-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b60f96-a9", "ovs_interfaceid": "51b60f96-a9a7-4241-95fb-8a670a49ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222462.994306) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] set metadata xml: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: tempest-device-tagging-server-1990495923 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 2026-07-05 03:34:22 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 192 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: True Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: bare Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: ide Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: pc Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348-project-member Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348 Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: Jul 05 03:34:22.996508 np0000004562 nova-compute[99148]: {{(pid=99148) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jul 05 03:34:23.055139 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Received event network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:23.055852 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] Acquiring lock "4220699d-7662-4f57-8f32-edb6e021063a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:23.056087 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:23.056248 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] Lock "4220699d-7662-4f57-8f32-edb6e021063a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:23.056425 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] No waiting events found dispatching network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:23.056572 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-80b17bb0-aa94-4ce9-92bf-12cab0fa1f66 req-2269bdd4-295d-4d9e-9856-7385b2d80908 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Received unexpected event network-vif-plugged-1376184c-f5e2-42c0-8803-ae6d2d58eabb for instance with vm_state building and task_state spawning. Jul 05 03:34:23.192616 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received event network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:23.192817 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:23.193067 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:23.193436 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:23.193665 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] No waiting events found dispatching network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:23.193839 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-eaf38809-ebc5-4ea3-88da-df88d452a14f req-843eff88-ace8-435b-bd66-2380bd4e12d6 service nova] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Received unexpected event network-vif-plugged-2a94f80a-2f06-44fb-93fd-18b014ef2d10 for instance with vm_state active and task_state None. Jul 05 03:34:23.323002 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:23.323002 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:23.365872 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:23.366112 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:23.454796 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance destroyed successfully. Jul 05 03:34:23.457017 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-954845619',display_name='tempest-ServerActionsTestOtherA-server-541569140',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-tempest-common-compute-instance-954845619',id=23,image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQGJH6Ej6W7yzdG7fGEfKEAFkNPXac69Goq1okOM8dODI5oTfjFBBL49VbKxoD/uOIM9ZC18+NWdFwO7ke10RkhqjlnDjLwR4CATa3Wb41wRrAe1vo1F7I4u1/dBohHgw==',key_name='tempest-keypair-60264763',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:29Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-n8b2fn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=7d3677fa-c41c-4c87-8991-c3d456184155,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:34:23.457243 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:23.458021 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:23.458323 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:34:23.464278 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.495147 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.504000 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-e3ca677c-ba14-4ca0-87d4-79d2d08f72a8 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "interface-86e756d2-be55-4c56-9c4c-0cba5eedc592-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 8.187s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:23.516215 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.516440 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4787b095-1d, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:23.522547 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:23.528447 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.532968 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.533232 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db54d6d6-6c1c-4f41-8d4c-042e1c5d7b90) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:23.534249 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.534856 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:23.535075 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.539435 np0000004562 nova-compute[99148]: INFO os_vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') Jul 05 03:34:23.540989 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:23.541478 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:23.541729 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:23.544588 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:23.545071 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:23.545265 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:23.573006 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:23.573229 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:23.573383 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:23.573510 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, 0): [] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:23.574234 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70') {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jul 05 03:34:23.574369 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, 0): [] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:23.574538 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70') {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jul 05 03:34:23.574674 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Resulting device map defaultdict(. at 0x7249b4323a60>, {}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:23.574843 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Disconnecting from: [] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:23.575066 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:23.575203 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== disconnect_volume: return (33ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:23.575345 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:23.575794 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Deleting instance files /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155_del Jul 05 03:34:23.576749 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Deletion of /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155_del complete Jul 05 03:34:23.678542 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.680983 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:23.766430 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:23.769070 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:23.770665 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:23.770818 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:23.771943 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No waiting events found dispatching network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:23.772059 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-066a7cd5-50fd-4dae-9bab-7f0104984203 req-c2db7e62-ad35-468f-a30d-74a4992a63f0 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state active and task_state rebuilding. Jul 05 03:34:23.833295 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lazy-loading 'flavor' on Instance uuid fcd1b284-0f6d-4a08-8d63-10328b665f2c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:23.876036 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=99148) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 05 03:34:23.876036 np0000004562 nova-compute[99148]: INFO nova.compute.claims [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Claim successful on node np0000004562 Jul 05 03:34:24.337375 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Ignoring supplied device name: /dev/vdb Jul 05 03:34:24.351924 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:34:24.352647 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:24.353079 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] VM Started (Lifecycle Event) Jul 05 03:34:24.355521 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:34:24.359115 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Instance spawned successfully. Jul 05 03:34:24.359743 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:34:24.381476 np0000004562 nova-compute[99148]: INFO nova.compute.resource_tracker [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating resource usage from migration 4cf6b60b-8bf3-4598-a074-83c944d45003 Jul 05 03:34:24.588074 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Booting with volume faeb56cb-8364-4088-a86f-a42d525eda70 at /dev/vdb Jul 05 03:34:24.609184 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:24.609184 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:24.644479 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:24.661113 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:24.683189 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:24.736920 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:24.737225 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:24.746528 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:24.748337 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76', 'fe80::f816:3eff:feb7:2e2c', 'fe80::f816:3eff:fe5f:e0d5', 'fe80::c02c:49ff:fe6e:7886', 'fe80::b8b8:a7ff:fe1f:b38a'] Jul 05 03:34:24.748611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:24.748611 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:24.749021 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:24.749326 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Updating existing volume attachment record: 80484946-19cd-4437-93bf-afb524c9cc4a {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:24.841828 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.519s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:24.857821 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:24.864994 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:24.870539 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:24.870539 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:24.871007 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:24.871393 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:24.871896 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:24.872279 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:25.064642 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=99148) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 05 03:34:25.064877 np0000004562 nova-compute[99148]: DEBUG nova.compute.provider_tree [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed in ProviderTree for provider: 555a8dfa-6105-4c91-843c-764798128d3b {{(pid=99148) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 05 03:34:25.114458 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'flavor' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:25.367823 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] During sync_power_state the instance has a pending task (spawning). Skip. Jul 05 03:34:25.368855 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Paused> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:25.368984 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] VM Paused (Lifecycle Event) Jul 05 03:34:25.378492 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Took 6.89 seconds to spawn the instance on the hypervisor. Jul 05 03:34:25.378733 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:25.567594 np0000004562 nova-compute[99148]: DEBUG nova.scheduler.client.report [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Inventory has not changed for provider 555a8dfa-6105-4c91-843c-764798128d3b based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=99148) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 05 03:34:25.832868 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:25.834548 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:25.834778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:25.834918 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:25.835060 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No waiting events found dispatching network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:25.835158 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-3a411b47-bc64-4f65-8382-859d220f03c7 req-ca58f14e-92ba-4761-a098-acec9092cb2a service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-unplugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state active and task_state rebuild_block_device_mapping. Jul 05 03:34:25.871321 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:25.873308 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:25.873451 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] VM Resumed (Lifecycle Event) Jul 05 03:34:25.893385 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Took 13.69 seconds to build instance. Jul 05 03:34:25.908191 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:25.908561 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:25.908749 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Attaching volume ea48ce3c-eab8-497d-b35a-e36c7a454b06 to /dev/vdb Jul 05 03:34:25.954898 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:25.970357 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:25.990634 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:26.030159 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:26.030474 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:26.039245 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:26.041615 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76', 'fe80::f816:3eff:feb7:2e2c', 'fe80::f816:3eff:fe5f:e0d5', 'fe80::c02c:49ff:fe6e:7886', 'fe80::b8b8:a7ff:fe1f:b38a'] Jul 05 03:34:26.041794 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:26.041941 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:26.042270 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:26.042635 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Updating existing volume attachment record: 1b56b075-4457-47df-8041-ea7ff22ede55 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:26.074501 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.708s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:26.074731 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Migrating Jul 05 03:34:26.074982 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:34:26.123027 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:26.376115 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:26.380825 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:26.395012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ffaeaa86-6b7e-4623-bd8d-804ed3714a76 tempest-AttachVolumeShelveTestJSON-1628552464 tempest-AttachVolumeShelveTestJSON-1628552464-project-member] Lock "4220699d-7662-4f57-8f32-edb6e021063a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.206s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:26.479566 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:26.593032 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:26.593032 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:26.593770 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:34:26.598308 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:26.598609 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:26.598792 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:26.599257 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:26.599577 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:26.611387 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:26.614855 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:26.614855 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:26.614855 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:26.614855 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:26.614855 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:26.630654 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:26.630654 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:26.631648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:26.631648 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06] added Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:26.644528 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:26.644826 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:26.645030 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:26.645231 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06] added Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:26.646280 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:26.646544 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:26.646704 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:26.646799 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:26.872599 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating instance directory {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 05 03:34:26.872961 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating image(s) Jul 05 03:34:26.873287 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:26.873287 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:26.873733 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "/opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:26.874008 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "a0679f5a57d62eac29148aa307bba7b627dc056b" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:26.874429 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "a0679f5a57d62eac29148aa307bba7b627dc056b" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:26.978295 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Received event network-changed-1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:26.978880 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Refreshing instance network info cache due to event network-changed-1376184c-f5e2-42c0-8803-ae6d2d58eabb. {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 05 03:34:26.979022 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] Acquiring lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:26.979106 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] Acquired lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:26.979215 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Refreshing network info cache for port 1376184c-f5e2-42c0-8803-ae6d2d58eabb {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 05 03:34:27.096504 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:27.215500 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:27.216677 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:27.219851 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Attaching volume 43cfad43-4e34-4de4-844e-41e5bc6f565f to /dev/vdb Jul 05 03:34:27.274548 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:27.287345 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:27.309027 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:27.346960 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:27.347975 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:27.360344 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:27.363177 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76', 'fe80::f816:3eff:feb7:2e2c', 'fe80::f816:3eff:fe5f:e0d5', 'fe80::c02c:49ff:fe6e:7886', 'fe80::b8b8:a7ff:fe1f:b38a'] Jul 05 03:34:27.363177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:27.363177 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:27.363433 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:27.363619 np0000004562 nova-compute[99148]: DEBUG nova.virt.block_device [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Updating existing volume attachment record: 2274a209-92d1-478e-af43-8391ec6dc1a2 {{(pid=99148) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 05 03:34:27.483969 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:27.500462 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:27.573676 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:27.576539 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:27.581202 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.part --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:27.645997 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:27.647993 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:27.659967 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:27.667656 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.677519 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.679361 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.part --force-share --output=json" returned: 0 in 0.098s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:27.679765 np0000004562 nova-compute[99148]: DEBUG nova.virt.images [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] d4d0b14d-ef4f-44e2-91ae-5227016c1981 was qcow2, converting to raw {{(pid=99148) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 05 03:34:27.680334 np0000004562 nova-compute[99148]: DEBUG nova.privsep.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=99148) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 05 03:34:27.680730 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.part /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.converted {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:27.694390 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.704622 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.704928 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.713047 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:27.730566 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:27.749935 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.50.100,3260] Jul 05 03:34:27.749935 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.50.100,3260] successful. Jul 05 03:34:27.749935 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.759996 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.40.100,3260] Jul 05 03:34:27.759996 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.40.100,3260] successful. Jul 05 03:34:27.759996 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.768980 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.775579 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.791479 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.791754 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:27.792146 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:27.792293 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:27.793442 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] HCTL ('7', '-', '-', 0) found on session 47 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:27.793554 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:27.811507 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:27.821038 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] HCTL ('8', '-', '-', 0) found on session 48 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:27.821038 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:27.822821 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Searching for a device in session 47 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:27.822821 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:27.833658 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Searching for a device in session 48 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:27.833658 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:27.889328 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.part /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.converted" returned: 0 in 0.208s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:27.897342 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.converted --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:27.959978 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:27.960492 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:27.960734 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:27.966355 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:28.024058 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b.converted --force-share --output=json" returned: 0 in 0.126s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.024254 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "a0679f5a57d62eac29148aa307bba7b627dc056b" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.150s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:28.024634 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:28.027967 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:28.029244 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:28.125512 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json" returned: 0 in 0.096s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.126038 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "a0679f5a57d62eac29148aa307bba7b627dc056b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:28.127238 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "a0679f5a57d62eac29148aa307bba7b627dc056b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:28.127875 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:28.133258 np0000004562 nova-compute[99148]: DEBUG oslo_utils.imageutils.format_inspector [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=99148) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 05 03:34:28.134158 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:28.156503 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Updated VIF entry in instance network info cache for port 1376184c-f5e2-42c0-8803-ae6d2d58eabb. {{(pid=99148) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 05 03:34:28.157678 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] [instance: 4220699d-7662-4f57-8f32-edb6e021063a] Updating instance_info_cache with network_info: [{"id": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "address": "fa:16:3e:b7:2e:2c", "network": {"id": "fffd26a2-d5f2-40f8-83ff-2669765e91f7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1875800652-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4a4342bd14c5411ebcb8a0835e1b48fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1376184c-f5", "ovs_interfaceid": "1376184c-f5e2-42c0-8803-ae6d2d58eabb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:28.229581 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json" returned: 0 in 0.095s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.230060 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b,backing_fmt=raw /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk 1073741824 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:28.246110 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:28.281706 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b,backing_fmt=raw /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk 1073741824" returned: 0 in 0.051s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.282130 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "a0679f5a57d62eac29148aa307bba7b627dc056b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:28.282508 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:28.369015 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0679f5a57d62eac29148aa307bba7b627dc056b --force-share --output=json" returned: 0 in 0.086s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.369480 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:34:28.369766 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:28.460198 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:28.460866 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Cannot resize image /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:34:28.461314 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Created local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 05 03:34:28.462264 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:34:28.462264 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:28.462451 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:28.462664 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:28.465363 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Start _get_guest_xml network_info=[{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-07-05T03:28:10Z,direct_url=,disk_format='qcow2',id=d4d0b14d-ef4f-44e2-91ae-5227016c1981,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-07-05T03:28:13Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '80484946-19cd-4437-93bf-afb524c9cc4a', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7d3677fa-c41c-4c87-8991-c3d456184155', 'attached_at': '', 'detached_at': '', 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'serial': 'faeb56cb-8364-4088-a86f-a42d525eda70'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:34:28.470161 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jul 05 03:34:28.473196 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='d4d0b14d-ef4f-44e2-91ae-5227016c1981', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-541569140', uuid='7d3677fa-c41c-4c87-8991-c3d456184155'), owner=OwnerMeta(userid='eddbc1b720fd44d0b36e9f9759161a98', username='tempest-ServerActionsTestOtherA-1550935099-project-member', projectid='fe307c595da542e184ffe93fcfd11d4c', projectname='tempest-ServerActionsTestOtherA-1550935099'), image=ImageMeta(id='d4d0b14d-ef4f-44e2-91ae-5227016c1981', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222468.4714847) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:34:28.473196 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:34:28.473607 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:34:28.474821 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:34:28.474821 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:34:28.475571 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:34:28.476075 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-07-05T03:28:10Z,direct_url=,disk_format='qcow2',id=d4d0b14d-ef4f-44e2-91ae-5227016c1981,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-07-05T03:28:13Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:34:28.476288 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:34:28.477070 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:34:28.477070 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:34:28.477070 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:34:28.477070 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:34:28.477232 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:34:28.477357 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:34:28.477522 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:34:28.477693 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:34:28.478348 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:34:28.478348 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:28.534778 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:28.615753 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:28.662024 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-8ab0d6fd-1946-45b3-9321-ec0320567197 req-8d8de773-50fc-4903-abf9-66729737a323 service nova] Releasing lock "refresh_cache-4220699d-7662-4f57-8f32-edb6e021063a" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:28.997473 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:28.998040 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:28.998240 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:29.632212 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Found WWN 33000000026e45bb0 for multipath device dm-0 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:29.632636 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:29.632764 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000026e45bb0', 'path': '/dev/dm-0', 'multipath_id': '33000000026e45bb0'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:29.632918 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000026e45bb0', 'path': '/dev/dm-0', 'multipath_id': '33000000026e45bb0'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:29.634454 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.674s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:29.635317 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:29.637463 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lazy-loading 'flavor' on Instance uuid fcd1b284-0f6d-4a08-8d63-10328b665f2c {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:29.655842 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:29.656571 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:29.657350 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:29.657886 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:29.658411 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:29.658812 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:29.671737 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:29.671737 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:29.678171 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:29.678171 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f] added Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:29.686902 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:29.687154 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:29.687273 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:29.687466 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f] added Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:29.689295 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:29.689549 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:29.689899 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:29.690124 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:29.764233 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Starting migrate_disk_and_power_off {{(pid=99148) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12672}} Jul 05 03:34:29.773743 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:29.782183 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.080422 np0000004562 nova-compute[99148]: DEBUG nova.utils [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Queued Task(fn=>, remaining_delay=14.999677220999956 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:30.081182 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance destroyed successfully. Jul 05 03:34:30.082389 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=25,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-bk092nur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=22ef7527-b9d6-4fde-aefc-20c4e4a0271b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 05 03:34:30.082686 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:30.083506 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:30.083781 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 05 03:34:30.106846 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.114941 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.128935 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.128935 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape425a405-5f, bridge=br-int, if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:30.133424 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:30.139169 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.140564 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Attempting to attach volume ea48ce3c-eab8-497d-b35a-e36c7a454b06 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:34:30.142147 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.142416 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac2ee4b5-a923-4165-becb-35da0891b100) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] attach device xml: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: Jul 05 03:34:30.143103 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:30.144467 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:30.145101 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.148828 np0000004562 nova-compute[99148]: INFO os_vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') Jul 05 03:34:30.286139 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.287879 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:30.338220 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:30.338607 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:30.338956 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:30.339330 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:30.339330 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] No waiting events found dispatching network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:30.339663 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-0f338540-5995-472f-87e7-efe8c0f68d9f req-7d30832a-67d6-4751-aaa4-0fd5be6b9214 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received unexpected event network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a for instance with vm_state active and task_state resize_migrating. Jul 05 03:34:30.687953 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:30.691277 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:30.696288 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Detected multiple connections on this host for volume: 96221486-3151-4c31-9565-944792a5ed20, skipping target disconnect. Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:30.703205 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.706024 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:30.723225 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.727105 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.745817 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.748164 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.748540 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.768306 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.768626 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:30.793845 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.40.100,3260] Jul 05 03:34:30.793845 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.40.100,3260] successful. Jul 05 03:34:30.793845 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.808367 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.816727 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.50.100,3260] Jul 05 03:34:30.816727 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.50.100,3260] successful. Jul 05 03:34:30.816727 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.825961 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:30.826663 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.844125 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.844661 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:30.846197 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:30.846517 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:30.846816 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:30.848772 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] HCTL ('15', '-', '-', 0) found on session 49 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:30.848939 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:30.868553 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:30.869091 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:30.869091 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Searching for a device in session 49 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:30.870591 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:30.871046 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] HCTL ('16', '-', '-', 0) found on session 50 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:30.871290 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:30.888224 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Searching for a device in session 50 and hctl ['16', '*', '*', 0] yield: None {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:30.944600 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:30.945119 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=99148) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 05 03:34:30.945949 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:31.049419 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk" returned: 0 in 0.103s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:31.049937 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk.config /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:31.103571 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk.config /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config" returned: 0 in 0.053s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:31.104059 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk.info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:31.145193 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "cp -r /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b_resize/disk.info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" returned: 0 in 0.041s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:31.491986 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:31.817172 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:31.817277 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:31.817401 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:31.817527 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] No VIF found with MAC fa:16:3e:ae:92:10, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:31.887788 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Searching for a device in session 50 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:31.887788 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:32.304725 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:32.305234 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:32.381997 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Port e425a405-5f9f-4291-953d-7cc71b8e3c7a binding to destination host np0000004562 is already ACTIVE {{(pid=99148) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jul 05 03:34:32.403101 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:32.404164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:32.404164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:32.404164 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:32.404307 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] No waiting events found dispatching network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:32.404431 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-bec7ad6b-64e3-45a2-9e60-affdf8ae4644 req-a58b72cc-d9c7-4fc6-8ce2-b98ca5b297fe service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received unexpected event network-vif-unplugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a for instance with vm_state active and task_state resize_migrating. Jul 05 03:34:32.673802 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Found WWN 330000000b89918c6 for multipath device dm-8 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:32.674190 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:32.674423 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] <== connect_volume: return (4713ms) {'type': 'block', 'scsi_wwn': '330000000b89918c6', 'path': '/dev/dm-8', 'multipath_id': '330000000b89918c6'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:32.674644 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b89918c6', 'path': '/dev/dm-8', 'multipath_id': '330000000b89918c6'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:32.675523 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.677s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:32.675858 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:32.680223 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'flavor' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:32.686926 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:32.687700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:32.688440 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:32.689051 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:32.689437 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:32.689752 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:32.701223 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:32.701223 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:32.706067 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:34:32.706067 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70] added Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:32.712625 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:32.712890 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:32.713051 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:32.713259 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70] added Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: iscsiadm: Config file line 363 does not have value Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:34:32.718287 np0000004562 nova-compute[99148]: {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:32.718459 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=99148) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:34:32.718661 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:34:32.718844 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=99148) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:34:33.182909 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Attempting to attach volume 43cfad43-4e34-4de4-844e-41e5bc6f565f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=99148) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] attach device xml: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: 43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: Jul 05 03:34:33.183933 np0000004562 nova-compute[99148]: {{(pid=99148) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 05 03:34:33.367895 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-9a1e5480-e8db-43d3-baaf-e0dce5f4da86 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.459s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:33.392637 np0000004562 nova-compute[99148]: DEBUG nova.compute.rpcapi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] RPC: Sending the message to topic: compute-alt {{(pid=99148) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 05 03:34:33.413088 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:33.413511 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:33.413654 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:33.713701 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:33.719212 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:33.725467 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.startup = manual Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.scan = auto Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:33.732555 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.736933 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.743929 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.756424 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.756951 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.761893 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.762163 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:33.803091 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] Jul 05 03:34:33.803091 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.40.100,3260] successful. Jul 05 03:34:33.803091 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.814012 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.817860 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] Jul 05 03:34:33.817860 np0000004562 nova-compute[99148]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70, portal: 192.168.50.100,3260] successful. Jul 05 03:34:33.817860 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.828824 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.833037 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:33.833534 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:33.834635 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] HCTL ('17', '-', '-', 0) found on session 51 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:33.834774 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:33.847561 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:33.848161 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:33.848391 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching for a device in session 51 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:33.848555 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:33.850114 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] HCTL ('18', '-', '-', 0) found on session 52 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:33.850338 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:33.864978 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Searching for a device in session 52 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:33.865191 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'faeb56cb-8364-4088-a86f-a42d525eda70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:34.416602 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:34.547471 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:34:34.547607 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquired lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:34:34.547793 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Building network info cache for instance {{(pid=99148) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 05 03:34:34.688866 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:34.837089 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:34.837348 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:34.837485 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] No VIF found with MAC fa:16:3e:7c:9e:58, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:35.049906 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:35.145284 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:35.329135 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 05 03:34:35.469828 np0000004562 nova-compute[99148]: DEBUG nova.network.neutron [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Updating instance_info_cache with network_info: [{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=99148) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 05 03:34:35.704099 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Found WWN 330000000e7257fe6 for multipath device dm-9 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:35.704410 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:35.704626 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] <== connect_volume: return (6705ms) {'type': 'block', 'scsi_wwn': '330000000e7257fe6', 'path': '/dev/dm-9', 'multipath_id': '330000000e7257fe6'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:35.704807 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e7257fe6', 'path': '/dev/dm-9', 'multipath_id': '330000000e7257fe6'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:35.971610 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Releasing lock "refresh_cache-22ef7527-b9d6-4fde-aefc-20c4e4a0271b" {{(pid=99148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:34:36.210626 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-954845619',display_name='tempest-ServerActionsTestOtherA-server-541569140',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-tempest-common-compute-instance-954845619',id=23,image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQGJH6Ej6W7yzdG7fGEfKEAFkNPXac69Goq1okOM8dODI5oTfjFBBL49VbKxoD/uOIM9ZC18+NWdFwO7ke10RkhqjlnDjLwR4CATa3Wb41wRrAe1vo1F7I4u1/dBohHgw==',key_name='tempest-keypair-60264763',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:29Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-n8b2fn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=7d3677fa-c41c-4c87-8991-c3d456184155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:34:36.210916 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:36.211405 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] End _get_guest_xml xml= Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: instance-00000017 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 196608 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-server-541569140 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 2026-07-05 03:34:28 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 192 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: True Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: bare Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099-project-member Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: tempest-ServerActionsTestOtherA-1550935099 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 7d3677fa-c41c-4c87-8991-c3d456184155 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: hvm Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 128 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: faeb56cb-8364-4088-a86f-a42d525eda70 Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: Jul 05 03:34:36.212857 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-954845619',display_name='tempest-ServerActionsTestOtherA-server-541569140',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-tempest-common-compute-instance-954845619',id=23,image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQGJH6Ej6W7yzdG7fGEfKEAFkNPXac69Goq1okOM8dODI5oTfjFBBL49VbKxoD/uOIM9ZC18+NWdFwO7ke10RkhqjlnDjLwR4CATa3Wb41wRrAe1vo1F7I4u1/dBohHgw==',key_name='tempest-keypair-60264763',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:29Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004562',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe307c595da542e184ffe93fcfd11d4c',ramdisk_id='',reservation_id='r-n8b2fn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d4d0b14d-ef4f-44e2-91ae-5227016c1981',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550935099',owner_user_name='tempest-ServerActionsTestOtherA-1550935099-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eddbc1b720fd44d0b36e9f9759161a98',uuid=7d3677fa-c41c-4c87-8991-c3d456184155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converting VIF {"id": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "address": "fa:16:3e:a3:af:99", "network": {"id": "fb6e4e19-6a74-4767-a0bf-2e87e247551a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-410761403-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe307c595da542e184ffe93fcfd11d4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4787b095-1d", "ovs_interfaceid": "4787b095-1de4-45d3-aa33-7dff0fefecf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:36.216792 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:34:36.218044 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.218044 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77230b1-6b1c-50b7-b59d-ae1aa170498c', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:36.219221 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.219221 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:36.219795 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.222469 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.222469 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4787b095-1d, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:36.222469 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4787b095-1d, col_values=(('qos', UUID('beaa4158-33a0-4c6f-864d-db12e329424c')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:36.222469 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4787b095-1d, col_values=(('external_ids', {'iface-id': '4787b095-1de4-45d3-aa33-7dff0fefecf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:af:99', 'vm-uuid': '7d3677fa-c41c-4c87-8991-c3d456184155'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:36.222765 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.224175 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:36.228177 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.233298 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.248505 np0000004562 nova-compute[99148]: INFO os_vif [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:af:99,bridge_name='br-int',has_traffic_filtering=True,id=4787b095-1de4-45d3-aa33-7dff0fefecf7,network=Network(fb6e4e19-6a74-4767-a0bf-2e87e247551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4787b095-1d') Jul 05 03:34:36.270187 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.279451 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.390255 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-a20b5791-3708-4f00-b813-adaa99f926cd tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.173s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:36.408917 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:36.409067 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:36.409188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:36.409347 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:36.409727 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No waiting events found dispatching network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:36.409884 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-b7c98948-d9ac-4a7c-b184-e3de87fee7bf req-f7047bca-f831-4f48-9991-a1bceed45e63 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state active and task_state rebuild_spawning. Jul 05 03:34:36.414910 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.416105 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.478911 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004562', 'execute': None}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:36.487991 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.scaleio [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=99148) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:34:36.493607 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:36.512046 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): nvme version {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:36.549291 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] 'nvme version' failed. Not Retrying. {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:34:36.549681 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] nvme not present on system {{(pid=99148) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:34:36.558276 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=99148) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:34:36.560425 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.lightos [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fe7c:9e58', 'fe80::bcb6:beff:fe61:e97a', 'fe80::f816:3eff:feae:9210', 'fe80::24c9:68ff:fe77:c7b3', 'fe80::f816:3eff:fe3e:cf76', 'fe80::f816:3eff:feb7:2e2c', 'fe80::f816:3eff:fe5f:e0d5', 'fe80::c02c:49ff:fe6e:7886', 'fe80::b8b8:a7ff:fe1f:b38a'] Jul 05 03:34:36.560593 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:34:36.560929 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] LIGHTOS: no hostnqn found. {{(pid=99148) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:34:36.561250 np0000004562 nova-compute[99148]: DEBUG os_brick.utils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:36.895234 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00043929000003117835 future=) submitted to {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:36.896732 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Emitting event Stopped> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:36.896987 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waiting for the next task {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:36.897250 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Stopped (Lifecycle Event) Jul 05 03:34:36.898415 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.181687186999852 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:36.898628 np0000004562 nova-compute[99148]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.181426200000033 future=) {{(pid=99148) _log /opt/stack/nova/nova/utils.py:1508}} Jul 05 03:34:37.402178 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:37.404922 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:37.746696 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Starting finish_migration {{(pid=99148) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12859}} Jul 05 03:34:37.748953 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Instance directory exists: not creating {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 05 03:34:37.749114 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Creating image(s) Jul 05 03:34:37.749935 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:37.772394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:37.772394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:37.772394 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:37.772571 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] No VIF found with MAC fa:16:3e:a3:af:99, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:37.774172 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Using config drive Jul 05 03:34:37.835576 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e56c95bbd4cd7a268dcc4b3976fdb6eed507d5b --force-share --output=json" returned: 0 in 0.085s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:37.836041 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk. size=1073741824 {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 05 03:34:37.836314 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:37.907172 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-57c14e2a-1f83-471c-8fe0-1c0fd6d7d6f4 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jul 05 03:34:37.920843 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:37.921244 np0000004562 nova-compute[99148]: DEBUG nova.virt.disk.api [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Cannot resize image /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk to a smaller size. {{(pid=99148) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 05 03:34:38.279969 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:38.372341 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:38.372812 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:38.407265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "4a23ad30-ca25-4cdd-bc41-596617129de7" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:38.407265 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:38.428150 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Did not create local disks {{(pid=99148) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 05 03:34:38.428150 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Ensure instance console log exists: /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/console.log {{(pid=99148) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 05 03:34:38.429689 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:38.429689 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:38.429689 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:38.433693 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Start _get_guest_xml network_info=[{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0c8fa207-3de5-4489-a2c5-f4cc8559edb8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '898021c4-0b37-4178-8c2b-812e6e320892', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '22ef7527-b9d6-4fde-aefc-20c4e4a0271b', 'attached_at': '2026-07-05T03:34:37.000000', 'detached_at': '', 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'multiattach': True, 'serial': '96221486-3151-4c31-9565-944792a5ed20'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 05 03:34:38.437944 np0000004562 nova-compute[99148]: WARNING nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 05 03:34:38.439387 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='22ef7527-b9d6-4fde-aefc-20c4e4a0271b'), owner=OwnerMeta(userid='13eaeef1f2334d698ac49202f06873c1', username='tempest-AttachVolumeMultiAttachTest-1524520621-project-member', projectid='4ef60743c71546fc87af8540e17c0506', projectname='tempest-AttachVolumeMultiAttachTest-1524520621'), image=ImageMeta(id='0c8fa207-3de5-4489-a2c5-f4cc8559edb8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783222478.4386399) {{(pid=99148) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 05 03:34:38.440362 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V1... {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 05 03:34:38.441129 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller missing on host. {{(pid=99148) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 05 03:34:38.441285 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching host: 'np0000004562' for CPU controller through CGroups V2... {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 05 03:34:38.441643 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.host [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU controller found on host. {{(pid=99148) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 05 03:34:38.442562 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=99148) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 05 03:34:38.442562 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-05T03:28:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-05T03:28:14Z,direct_url=,disk_format='qcow2',id=0c8fa207-3de5-4489-a2c5-f4cc8559edb8,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='1911e8eebd7145b9bd49ab61ecf621cb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-05T03:28:17Z,virtual_size=,visibility=), allow threads: True {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 05 03:34:38.443133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 05 03:34:38.443133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image limits 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 05 03:34:38.443133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Flavor pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 05 03:34:38.443133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Image pref 0:0:0 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 05 03:34:38.443133 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99148) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 05 03:34:38.443312 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 05 03:34:38.443312 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 05 03:34:38.443666 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Got 1 possible topologies {{(pid=99148) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 05 03:34:38.443666 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 05 03:34:38.443666 np0000004562 nova-compute[99148]: DEBUG nova.virt.hardware [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=99148) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 05 03:34:38.454064 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config --force-share --output=json {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:38.473388 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:38.474021 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] Acquiring lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:38.474281 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:38.474448 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] Lock "7d3677fa-c41c-4c87-8991-c3d456184155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:38.474694 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] No waiting events found dispatching network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:38.474882 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-d42be319-6499-4c25-a515-4c11061b5ada req-a2d53120-5ca7-45fb-9020-b008ad4ebcf8 service nova] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Received unexpected event network-vif-plugged-4787b095-1de4-45d3-aa33-7dff0fefecf7 for instance with vm_state active and task_state rebuild_spawning. Jul 05 03:34:38.541008 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:38.541443 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:38.541672 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:38.542181 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "/opt/stack/data/nova/instances/22ef7527-b9d6-4fde-aefc-20c4e4a0271b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:38.542589 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Calling os-brick to attach iSCSI Volume {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 05 03:34:38.543359 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:38.543359 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:38.543523 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:38.543853 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:34:38.557673 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:38.558231 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:38.558841 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:38.559380 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:38.559680 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:34:38.559948 np0000004562 nova-compute[99148]: INFO os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.40.100 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:38.575118 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.name = iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.tpgt = -1 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.startup = automatic Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.leading_login = No Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.iscsi_ifacename = default Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.net_ifacename = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.ipaddress = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.prefix_len = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.hwaddress = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.transport_name = tcp Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.initiatorname = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.vlan_id = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.vlan_priority = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.vlan_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.iface_num = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.mtu = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.port = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.bootproto = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.subnet_mask = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.gateway = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_alt_client_id = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_dns = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_learn_iqn = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_req_vendor_id_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_vendor_id = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.dhcp_slp_da = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.fragmentation = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.gratuitous_arp = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.incoming_forwarding = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tos_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tos = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.ttl = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.delayed_ack = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tcp_nagle = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tcp_wsf_state = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tcp_wsf = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tcp_timer_scale = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.tcp_timestamp = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.redirect = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.def_task_mgmt_timeout = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.header_digest = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.data_digest = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.immediate_data = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.initial_r2t = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.data_seq_inorder = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.data_pdu_inorder = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.erl = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.max_receive_data_len = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.first_burst_len = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.max_outstanding_r2t = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.max_burst_len = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.chap_auth = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.bidi_chap = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.strict_login_compliance = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.discovery_auth = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: iface.discovery_logout = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.discovery_address = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.discovery_port = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.discovery_type = fw Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.initial_cmdsn = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.initial_login_retry_max = 8 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.xmit_thread_priority = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.cmds_max = 128 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.queue_depth = 32 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.nr_sessions = 1 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.authmethod = None Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.username = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.password = *** Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.username_in = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.password_in = Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.auth.chap_algs = SHA256 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.timeo.replacement_timeout = 120 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.FastAbort = Yes Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.InitialR2T = No Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.ImmediateData = Yes Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.MaxConnections = 1 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.iscsi.ERL = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.scan = manual Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.session.reopen_max = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].address = 192.168.50.100 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].port = 3260 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].startup = manual Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].tcp.window_size = 524288 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.DataDigest = None Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.IFMarker = No Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: node.conn[0].iscsi.OFMarker = No Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: # END RECORD Jul 05 03:34:38.577341 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:38.588503 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:38.595481 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.607364 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.608246 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:38.608674 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:38.608844 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.40.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:38.609799 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('14', '0', '0', 0) found on session 44 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:38.609952 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.614490 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:38.614847 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:38.615187 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:38.615187 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to 192.168.50.100:3260 {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:34:38.615926 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] HCTL ('13', '0', '0', 0) found on session 43 with lun 0 {{(pid=99148) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:34:38.615926 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=99148) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:34:38.624682 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 44 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:38.625002 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:38.625648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Searching for a device in session 43 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=99148) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:34:38.625648 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96221486-3151-4c31-9565-944792a5ed20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=99148) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:34:38.783730 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Object Instance<7d3677fa-c41c-4c87-8991-c3d456184155> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:34:38.784143 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lazy-loading 'keypairs' on Instance uuid 7d3677fa-c41c-4c87-8991-c3d456184155 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:38.875472 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Detaching volume 43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:38.910921 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Detaching volume 089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:34:38.920995 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Attempting to driver detach volume 43cfad43-4e34-4de4-844e-41e5bc6f565f from mountpoint /dev/vdb Jul 05 03:34:38.926787 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Found disk vdb by alias ua-43cfad43-4e34-4de4-844e-41e5bc6f565f {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:38.928272 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Found disk vdb by alias ua-43cfad43-4e34-4de4-844e-41e5bc6f565f {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:38.928532 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Attempting to detach device vdb from instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] detach device xml: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: 43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]:
Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: Jul 05 03:34:38.928803 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:38.937345 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Successfully detached device vdb from instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 from the persistent domain config. Jul 05 03:34:38.937603 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] (1/8): Attempting to detach device vdb with device alias ua-43cfad43-4e34-4de4-844e-41e5bc6f565f from instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] detach device xml: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: 43cfad43-4e34-4de4-844e-41e5bc6f565f Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]:
Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: Jul 05 03:34:38.937983 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:38.950333 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Attempting to driver detach volume 089a0fef-69ed-4d40-82af-e702bd977251 from mountpoint /dev/vdb Jul 05 03:34:38.954248 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Found disk vdb by alias ua-089a0fef-69ed-4d40-82af-e702bd977251 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:38.955358 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Found disk vdb by alias ua-089a0fef-69ed-4d40-82af-e702bd977251 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:38.955517 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Attempting to detach device vdb from instance 4a23ad30-ca25-4cdd-bc41-596617129de7 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] detach device xml: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: 089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]:
Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: Jul 05 03:34:38.955789 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:38.961807 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Successfully detached device vdb from instance 4a23ad30-ca25-4cdd-bc41-596617129de7 from the persistent domain config. Jul 05 03:34:38.961964 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] (1/8): Attempting to detach device vdb with device alias ua-089a0fef-69ed-4d40-82af-e702bd977251 from instance 4a23ad30-ca25-4cdd-bc41-596617129de7 from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] detach device xml: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: 089a0fef-69ed-4d40-82af-e702bd977251 Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]:
Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: Jul 05 03:34:38.962270 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:39.287653 np0000004562 nova-compute[99148]: DEBUG nova.objects.base [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Object Instance<7d3677fa-c41c-4c87-8991-c3d456184155> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=99148) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 05 03:34:39.292021 np0000004562 nova-compute[99148]: WARNING neutronclient.v2_0.client [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jul 05 03:34:39.452505 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Creating config drive at /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config Jul 05 03:34:39.458702 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpka98z9w0 {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:34:39.483185 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-43cfad43-4e34-4de4-844e-41e5bc6f565f> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:34:39.483951 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-43cfad43-4e34-4de4-844e-41e5bc6f565f for instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:34:39.491181 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Successfully detached device vdb from instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 from the live domain config. Jul 05 03:34:39.492876 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:39.493842 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:39.496733 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:39.523743 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.processutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d3677fa-c41c-4c87-8991-c3d456184155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpka98z9w0" returned: 0 in 0.065s {{(pid=99148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:34:39.561092 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 05 03:34:39.594802 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-089a0fef-69ed-4d40-82af-e702bd977251> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:34:39.595220 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-089a0fef-69ed-4d40-82af-e702bd977251 for instance 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:34:39.597917 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Successfully detached device vdb from instance 4a23ad30-ca25-4cdd-bc41-596617129de7 from the live domain config. Jul 05 03:34:39.599177 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:39.599544 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:39.599726 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:39.990545 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:40.498860 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:40.499012 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:40.570901 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-b56ba1b3-8d2a-4ba5-bc57-e571311170d2 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "fcd1b284-0f6d-4a08-8d63-10328b665f2c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:40.576171 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Found WWN 330000000287f3257 for multipath device dm-5 {{(pid=99148) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 05 03:34:40.576548 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:40.576741 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:40.577083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000287f3257', 'path': '/dev/dm-5', 'multipath_id': '330000000287f3257'} {{(pid=99148) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 05 03:34:40.577608 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.083s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:40.577897 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43cfad43-4e34-4de4-844e-41e5bc6f565f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:40.578077 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.608469 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.608770 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:40.608978 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '52')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:40.609032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', '49')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:40.610680 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f', '50')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:40.611574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Resulting device map defaultdict(. at 0x7249ac3d4ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'): ({'sdk'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:40.611878 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Removing multipathed devices sdk, sdj {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:34:40.612209 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Flush multipath device 330000000b89918c6 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:34:40.646196 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:40.693250 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:40.694727 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Resumed> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:40.694902 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Resumed (Lifecycle Event) Jul 05 03:34:40.701212 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance event wait completed in 0 seconds for {{(pid=99148) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 05 03:34:40.701484 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Guest created on hypervisor {{(pid=99148) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 05 03:34:40.705153 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [-] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Instance spawned successfully. Jul 05 03:34:40.705153 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 05 03:34:40.746199 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:34:40.746351 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:34:40.748249 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:34:40.761673 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:34:40.761985 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:40.773692 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.818629 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.40.100,3260] Jul 05 03:34:40.818629 np0000004562 nova-compute[99148]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.40.100,3260] successful. Jul 05 03:34:40.818629 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.838134 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.849295 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.885886 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.50.100,3260] Jul 05 03:34:40.885886 np0000004562 nova-compute[99148]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-43cfad43-4e34-4de4-844e-41e5bc6f565f, portal: 192.168.50.100,3260] successful. Jul 05 03:34:40.885886 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.903688 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:40.903879 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:40.904013 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] <== disconnect_volume: return (1410ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:40.904155 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] [instance: 86e756d2-be55-4c56-9c4c-0cba5eedc592] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:40.907045 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.307s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:40.907426 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '089a0fef-69ed-4d40-82af-e702bd977251', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:40.907596 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.933959 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:40.934206 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:40.934443 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '52')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:40.934443 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '39')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:40.935574 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251', '40')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:40.936621 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Resulting device map defaultdict(. at 0x7249ac4380e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'): ({'sdg'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:40.936938 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Removing multipathed devices sdf, sdg {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:34:40.937234 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Flush multipath device 3300000001935b047 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:34:40.968422 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:41.004122 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Detaching volume ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:41.020211 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:41.049676 np0000004562 nova-compute[99148]: INFO nova.virt.block_device [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Attempting to driver detach volume ea48ce3c-eab8-497d-b35a-e36c7a454b06 from mountpoint /dev/vdb Jul 05 03:34:41.053000 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Found disk vdb by alias ua-ea48ce3c-eab8-497d-b35a-e36c7a454b06 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:41.053921 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Found disk vdb by alias ua-ea48ce3c-eab8-497d-b35a-e36c7a454b06 {{(pid=99148) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 05 03:34:41.054044 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Attempting to detach device vdb from instance fcd1b284-0f6d-4a08-8d63-10328b665f2c from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] detach device xml: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]:
Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: Jul 05 03:34:41.054351 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:41.060122 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Successfully detached device vdb from instance fcd1b284-0f6d-4a08-8d63-10328b665f2c from the persistent domain config. Jul 05 03:34:41.060281 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] (1/8): Attempting to detach device vdb with device alias ua-ea48ce3c-eab8-497d-b35a-e36c7a454b06 from instance fcd1b284-0f6d-4a08-8d63-10328b665f2c from the live domain config. {{(pid=99148) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] detach device xml: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: ea48ce3c-eab8-497d-b35a-e36c7a454b06 Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]:
Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: Jul 05 03:34:41.060568 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:41.074158 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:34:41.074365 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:34:41.076005 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:34:41.084621 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=25,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-bk092nur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=22ef7527-b9d6-4fde-aefc-20c4e4a0271b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:34:41.084871 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:41.085578 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:41.087420 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:34:41.087566 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] End _get_guest_xml xml= Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: instance-00000019 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 262144 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: multiattach-server-0 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 2026-07-05 03:34:38 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 256 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: True Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: bare Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: ide Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: pc Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621-project-member Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: tempest-AttachVolumeMultiAttachTest-1524520621 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: hvm Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 128 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: 96221486-3151-4c31-9565-944792a5ed20 Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: /dev/urandom Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: Jul 05 03:34:41.089112 np0000004562 nova-compute[99148]: {{(pid=99148) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 05 03:34:41.091518 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004562',hostname='multiattach-server-0',id=25,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1jsRKyxxW6lY95suPNCqYwfhrI62XNHcCA9TxDMX9FLX88EaiINvF17h34jnX4xuacpGEj0xZrdwYts5p32m1oA+eWKeNOaltziTsD42V6KIH/PiWSukfsbnfg5PLeNg==',key_name='tempest-keypair-292561231',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:41Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004562',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ef60743c71546fc87af8540e17c0506',ramdisk_id='',reservation_id='r-bk092nur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1524520621',owner_user_name='tempest-AttachVolumeMultiAttachTest-1524520621-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-05T03:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13eaeef1f2334d698ac49202f06873c1',uuid=22ef7527-b9d6-4fde-aefc-20c4e4a0271b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 05 03:34:41.091518 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converting VIF {"id": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "address": "fa:16:3e:9a:87:e9", "network": {"id": "1f3aac47-3490-4029-857d-b28fb8507eaf", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-667003812-network", "vif_mac": "fa:16:3e:9a:87:e9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ef60743c71546fc87af8540e17c0506", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape425a405-5f", "ovs_interfaceid": "e425a405-5f9f-4291-953d-7cc71b8e3c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:41.091518 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:41.091518 np0000004562 nova-compute[99148]: DEBUG os_vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') {{(pid=99148) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 05 03:34:41.094500 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.094751 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:41.094992 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 05 03:34:41.097616 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.097816 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63815119-ef68-59be-92c6-60c9758f84d7', '_type': 'linux-noop'}}, row=False) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:41.099254 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.106564 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.107336 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:41.110502 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.119953 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.120140 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape425a405-5f, may_exist=True, interface_attrs={}) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:41.120522 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape425a405-5f, col_values=(('qos', UUID('e5a65cd0-130f-4885-bdce-ff0121f69820')),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:41.122017 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape425a405-5f, col_values=(('external_ids', {'iface-id': 'e425a405-5f9f-4291-953d-7cc71b8e3c7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:87:e9', 'vm-uuid': '22ef7527-b9d6-4fde-aefc-20c4e4a0271b'}),), if_exists=True) {{(pid=99148) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 05 03:34:41.125283 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 05 03:34:41.129544 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.138886 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.150408 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.40.100,3260] Jul 05 03:34:41.150408 np0000004562 nova-compute[99148]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.40.100,3260] successful. Jul 05 03:34:41.150408 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.156496 np0000004562 nova-compute[99148]: INFO os_vif [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:87:e9,bridge_name='br-int',has_traffic_filtering=True,id=e425a405-5f9f-4291-953d-7cc71b8e3c7a,network=Network(1f3aac47-3490-4029-857d-b28fb8507eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape425a405-5f') Jul 05 03:34:41.175240 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.180764 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.184384 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.195571 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.198398 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:41.200527 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_cdrom_bus of ide {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_disk_bus of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_input_bus of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_pointer_model of None {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_video_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.212792 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Found default for hw_vif_model of virtio {{(pid=99148) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 05 03:34:41.236240 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.50.100,3260] Jul 05 03:34:41.236240 np0000004562 nova-compute[99148]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-089a0fef-69ed-4d40-82af-e702bd977251, portal: 192.168.50.100,3260] successful. Jul 05 03:34:41.236240 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.256032 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:41.256930 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:41.257299 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] <== disconnect_volume: return (1657ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:41.257627 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] [instance: 4a23ad30-ca25-4cdd-bc41-596617129de7] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:41.302285 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.303147 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.344750 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:41.344857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:41.345021 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:41.345157 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:41.345281 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] No waiting events found dispatching network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:41.345412 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-c594179e-ec7a-442f-8729-4330c1544e61 req-e46e4c1e-baff-446c-8494-9b415ccc9b54 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received unexpected event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a for instance with vm_state active and task_state resize_finish. Jul 05 03:34:41.469091 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'flavor' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:41.495812 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:41.605094 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ea48ce3c-eab8-497d-b35a-e36c7a454b06 for instance fcd1b284-0f6d-4a08-8d63-10328b665f2c {{(pid=99148) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 05 03:34:41.703273 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jul 05 03:34:41.703431 np0000004562 nova-compute[99148]: DEBUG nova.virt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Emitting event Started> {{(pid=99148) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 05 03:34:41.703558 np0000004562 nova-compute[99148]: INFO nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] VM Started (Lifecycle Event) Jul 05 03:34:41.717076 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:41.802998 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lazy-loading 'flavor' on Instance uuid 4a23ad30-ca25-4cdd-bc41-596617129de7 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:42.205920 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Checking state {{(pid=99148) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 05 03:34:42.210689 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=99148) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 05 03:34:42.224827 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:42.224932 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:42.225085 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] [instance: 7d3677fa-c41c-4c87-8991-c3d456184155] Trying to apply a migration context that does not seem to be set for this instance {{(pid=99148) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jul 05 03:34:42.590100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Acquiring lock "interface-86e756d2-be55-4c56-9c4c-0cba5eedc592-2a94f80a-2f06-44fb-93fd-18b014ef2d10" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:42.590100 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "interface-86e756d2-be55-4c56-9c4c-0cba5eedc592-2a94f80a-2f06-44fb-93fd-18b014ef2d10" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:42.674083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:42.674083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:42.674083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No BDM found with device name hda, not building metadata. {{(pid=99148) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 05 03:34:42.674083 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] No VIF found with MAC fa:16:3e:9a:87:e9, not building metadata {{(pid=99148) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 05 03:34:42.674083 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-ccb6986d-9dfd-43ec-b8cd-bc59eb7accc6 tempest-AttachVolumeMultiAttachTest-1524520621 tempest-AttachVolumeMultiAttachTest-1524520621-project-member] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Using config drive Jul 05 03:34:42.713238 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-d26f0d34-1013-4bb6-9925-448e80db3320 None None] Received event ua-ea48ce3c-eab8-497d-b35a-e36c7a454b06> from libvirt while the driver is waiting for it; dispatched. {{(pid=99148) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 05 03:34:42.722214 np0000004562 nova-compute[99148]: INFO nova.virt.libvirt.driver [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Successfully detached device vdb from instance fcd1b284-0f6d-4a08-8d63-10328b665f2c from the live domain config. Jul 05 03:34:42.724698 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] calling os-brick to detach iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 05 03:34:42.724698 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:34:42.724698 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:34:42.724698 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:34:42.724973 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ea48ce3c-eab8-497d-b35a-e36c7a454b06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:34:42.725119 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', 0)] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70 (non-flash) Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96221486-3151-4c31-9565-944792a5ed20', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-faeb56cb-8364-4088-a86f-a42d525eda70', '52')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:34:42.756216 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '48')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:42.758855 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06', '47')] {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:34:42.759295 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Resulting device map defaultdict(. at 0x7249ac419940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'): ({'sdb'}, set())}) {{(pid=99148) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:34:42.759627 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Removing multipathed devices sdc, sdb {{(pid=99148) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:34:42.759944 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Flush multipath device 33000000026e45bb0 {{(pid=99148) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:34:42.807857 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-c3330686-bbe8-443b-a212-d99e4326b587 tempest-ServerStableDeviceRescueTest-1168613683 tempest-ServerStableDeviceRescueTest-1168613683-project-member] Lock "4a23ad30-ca25-4cdd-bc41-596617129de7" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.400s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:42.817360 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:42.876538 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=99148) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:34:42.938302 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:34:42.938858 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=99148) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:34:42.939907 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:34:42.952595 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.linuxscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=99148) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:34:42.952857 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06')] {{(pid=99148) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:34:42.965363 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:42.984279 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-4f0d23a8-f27f-4311-bf94-0de7db50a33e tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lock "86e756d2-be55-4c56-9c4c-0cba5eedc592" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.611s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:43.005121 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.40.100,3260] Jul 05 03:34:43.005121 np0000004562 nova-compute[99148]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.40.100,3260] successful. Jul 05 03:34:43.005121 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:43.025308 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:43.036346 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:43.070700 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.50.100,3260] Jul 05 03:34:43.070700 np0000004562 nova-compute[99148]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-ea48ce3c-eab8-497d-b35a-e36c7a454b06, portal: 192.168.50.100,3260] successful. Jul 05 03:34:43.070700 np0000004562 nova-compute[99148]: stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:43.085731 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=99148) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:34:43.086049 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.base [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:34:43.086243 np0000004562 nova-compute[99148]: DEBUG os_brick.initiator.connectors.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] <== disconnect_volume: return (362ms) None {{(pid=99148) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:34:43.086418 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66cbfaf8-13da-447f-a226-fc7d5e7bb829 tempest-VolumesSnapshotTestJSON-1023273812 tempest-VolumesSnapshotTestJSON-1023273812-project-member] [instance: fcd1b284-0f6d-4a08-8d63-10328b665f2c] Disconnected iSCSI Volume {{(pid=99148) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 05 03:34:43.092756 np0000004562 nova-compute[99148]: DEBUG nova.objects.instance [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Lazy-loading 'flavor' on Instance uuid 86e756d2-be55-4c56-9c4c-0cba5eedc592 {{(pid=99148) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 05 03:34:43.123006 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:43.133116 np0000004562 nova-compute[99148]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=99148) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 05 03:34:43.234778 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [None req-79cc5382-9759-4278-8f0a-fbb303865b43 tempest-ServerActionsTestOtherA-1550935099 tempest-ServerActionsTestOtherA-1550935099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.009s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:43.454675 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 05 03:34:43.455042 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] Acquiring lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:34:43.455188 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:34:43.455305 np0000004562 nova-compute[99148]: DEBUG oslo_concurrency.lockutils [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] Lock "22ef7527-b9d6-4fde-aefc-20c4e4a0271b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=99148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:34:43.455469 np0000004562 nova-compute[99148]: DEBUG nova.compute.manager [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] No waiting events found dispatching network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a {{(pid=99148) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 05 03:34:43.455585 np0000004562 nova-compute[99148]: WARNING nova.compute.manager [req-f1d37f0c-3aa3-46ac-b326-368b7a6d23f9 req-e7140e56-9f91-4a3e-a283-f9782d5a1f14 service nova] [instance: 22ef7527-b9d6-4fde-aefc-20c4e4a0271b] Received unexpected event network-vif-plugged-e425a405-5f9f-4291-953d-7cc71b8e3c7a for instance with vm_state active and task_state resize_finish. Jul 05 03:34:43.598738 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.vif [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-05T03:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1990495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004562',hostname='tempest-device-tagging-server-1990495923',id=24,image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJmvibn5BkLSUlJMsgt1RKvuVGfG7uZnvd4JXoCby+3TWg+md0gz1ND9h+rR2uzgIYiZIX0Rl4AR9J1f17jaT0Nt3tT83TEtSKmG3b2uTO8rhzAO0Jgb65pkV/Ln68Usg==',key_name='tempest-keypair-820072378',keypairs=,launch_index=0,launched_at=2026-07-05T03:33:36Z,launched_on='np0000004562',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004562',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='46eb0f51c1c14cd59248f83bc46d358a',ramdisk_id='',reservation_id='r-91d27z59',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8fa207-3de5-4489-a2c5-f4cc8559edb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1679654348',owner_user_name='tempest-TaggedAttachmentsTest-1679654348-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-05T03:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e352bca5045491e9822ecc25b5ff38e',uuid=86e756d2-be55-4c56-9c4c-0cba5eedc592,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=99148) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 05 03:34:43.598738 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converting VIF {"id": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "address": "fa:16:3e:5f:e0:d5", "network": {"id": "0dc53a67-ffc2-4316-a42f-e686faeb1b61", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-38715491", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46eb0f51c1c14cd59248f83bc46d358a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": true, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a94f80a-2f", "ovs_interfaceid": "2a94f80a-2f06-44fb-93fd-18b014ef2d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 05 03:34:43.598738 np0000004562 nova-compute[99148]: DEBUG nova.network.os_vif_util [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e0:d5,bridge_name='br-int',has_traffic_filtering=True,id=2a94f80a-2f06-44fb-93fd-18b014ef2d10,network=Network(0dc53a67-ffc2-4316-a42f-e686faeb1b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a94f80a-2f') {{(pid=99148) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 05 03:34:43.602103 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] looking for interface given config: {{(pid=99148) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 05 03:34:43.603657 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] looking for interface given config: {{(pid=99148) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 05 03:34:43.606025 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.driver [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] Attempting to detach device tap2a94f80a-2f from instance 86e756d2-be55-4c56-9c4c-0cba5eedc592 from the persistent domain config. {{(pid=99148) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] detach device xml: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: Jul 05 03:34:43.606332 np0000004562 nova-compute[99148]: {{(pid=99148) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 05 03:34:43.614898 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] looking for interface given config: {{(pid=99148) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: DEBUG nova.virt.libvirt.guest [None req-af049471-5b78-4b69-ae1b-34965f3edb73 tempest-TaggedAttachmentsTest-1679654348 tempest-TaggedAttachmentsTest-1679654348-project-member] interface for config: not found in domain: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: instance-00000018 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: tempest-device-tagging-server-1990495923 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 2026-07-05 03:34:22 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 192 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: True Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: bare Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: qcow2 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 0 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: ide Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: pc Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: virtio Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348-project-member Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: tempest-TaggedAttachmentsTest-1679654348 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 196608 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 196608 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 1 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: /machine Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: OpenStack Foundation Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: OpenStack Nova Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 33.1.0 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 86e756d2-be55-4c56-9c4c-0cba5eedc592 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Virtual Machine Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: hvm Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: 131072 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Nehalem Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: destroy Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: restart Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: destroy Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: /usr/bin/qemu-system-x86_64 Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]:
Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]:
Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]:
Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]:
Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]:
Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: Jul 05 03:34:43.620362 np0000004562 nova-compute[99148]: